-- Logs begin at Sun 2022-08-07 00:10:47 UTC, end at Sun 2022-08-07 01:40:06 UTC. -- Aug 07 00:57:35.512256 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 00:57:35.520677 dv-cinder-master-3-smb devstack@keystone.service[80495]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 00:57:35.523341 dv-cinder-master-3-smb devstack@keystone.service[80495]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 00:57:35 2022] *** Aug 07 00:57:35.523526 dv-cinder-master-3-smb devstack@keystone.service[80495]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 00:57:35.523676 dv-cinder-master-3-smb devstack@keystone.service[80495]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 00:57:35.523807 dv-cinder-master-3-smb devstack@keystone.service[80495]: nodename: dv-cinder-master-3-smb Aug 07 00:57:35.523944 dv-cinder-master-3-smb devstack@keystone.service[80495]: machine: x86_64 Aug 07 00:57:35.524084 dv-cinder-master-3-smb devstack@keystone.service[80495]: clock source: unix Aug 07 00:57:35.524217 dv-cinder-master-3-smb devstack@keystone.service[80495]: pcre jit disabled Aug 07 00:57:35.524351 dv-cinder-master-3-smb devstack@keystone.service[80495]: detected number of CPU cores: 4 Aug 07 00:57:35.524490 dv-cinder-master-3-smb devstack@keystone.service[80495]: current working directory: / Aug 07 00:57:35.524624 dv-cinder-master-3-smb devstack@keystone.service[80495]: detected binary path: /usr/bin/uwsgi-core Aug 07 00:57:35.524765 dv-cinder-master-3-smb devstack@keystone.service[80495]: your processes number limit is 47680 Aug 07 00:57:35.524900 dv-cinder-master-3-smb devstack@keystone.service[80495]: your memory page size is 4096 bytes Aug 07 00:57:35.525036 dv-cinder-master-3-smb devstack@keystone.service[80495]: detected max file descriptor number: 2048 Aug 07 00:57:35.525179 dv-cinder-master-3-smb devstack@keystone.service[80495]: lock engine: pthread robust mutexes Aug 07 00:57:35.525463 dv-cinder-master-3-smb devstack@keystone.service[80495]: thunder lock: enabled Aug 07 00:57:35.525791 dv-cinder-master-3-smb devstack@keystone.service[80495]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 00:57:35.525913 dv-cinder-master-3-smb devstack@keystone.service[80495]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 00:57:35.565007 dv-cinder-master-3-smb devstack@keystone.service[80495]: Python main interpreter initialized at 0x5630f64bc9c0 Aug 07 00:57:35.565007 dv-cinder-master-3-smb devstack@keystone.service[80495]: python threads support enabled Aug 07 00:57:35.565007 dv-cinder-master-3-smb devstack@keystone.service[80495]: your server socket listen backlog is limited to 100 connections Aug 07 00:57:35.565007 dv-cinder-master-3-smb devstack@keystone.service[80495]: your mercy for graceful operations on workers is 90 seconds Aug 07 00:57:35.565433 dv-cinder-master-3-smb devstack@keystone.service[80495]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 00:57:35.565538 dv-cinder-master-3-smb devstack@keystone.service[80495]: *** Operational MODE: preforking *** Aug 07 00:57:35.565808 dv-cinder-master-3-smb devstack@keystone.service[80495]: *** uWSGI is running in multiple interpreter mode *** Aug 07 00:57:35.565808 dv-cinder-master-3-smb devstack@keystone.service[80495]: spawned uWSGI master process (pid: 80495) Aug 07 00:57:35.566035 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 07 00:57:35.569369 dv-cinder-master-3-smb devstack@keystone.service[80495]: spawned uWSGI worker 1 (pid: 80508, cores: 1) Aug 07 00:57:35.569369 dv-cinder-master-3-smb devstack@keystone.service[80495]: spawned uWSGI worker 2 (pid: 80509, cores: 1) Aug 07 00:57:35.569369 dv-cinder-master-3-smb devstack@keystone.service[80495]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 00:57:41.094596 dv-cinder-master-3-smb devstack@keystone.service[80509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:41.094596 dv-cinder-master-3-smb devstack@keystone.service[80509]: from cryptography.utils import int_from_bytes Aug 07 00:57:41.095380 dv-cinder-master-3-smb devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:41.095380 dv-cinder-master-3-smb devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Aug 07 00:57:41.095813 dv-cinder-master-3-smb devstack@keystone.service[80509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:41.095813 dv-cinder-master-3-smb devstack@keystone.service[80509]: from cryptography.utils import int_from_bytes Aug 07 00:57:41.095935 dv-cinder-master-3-smb devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:41.095935 dv-cinder-master-3-smb devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Aug 07 00:57:41.145011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:57:41.145206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:57:41.145395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] command line args: [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:57:41.145668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:57:41.145871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ================================================================================ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:57:41.146135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.146219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:57:41.146386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_dir = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.146464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:57:41.146575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.146665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] command line args: [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:57:41.146743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_source = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.146858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:57:41.146939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] debug = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ================================================================================ {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:57:41.147127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] admin_token = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] config_dir = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.147924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] config_source = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] debug = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_config_append = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.148973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_dir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_config_append = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.149897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_dir = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_file = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.150916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.151963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.152961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] publish_errors = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.153747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] publish_errors = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] standard_threads = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.154994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_journal = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_json = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] standard_threads = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_stderr = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_syslog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.155915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.156451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] use_journal = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.156625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] use_json = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] use_stderr = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.156870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] use_syslog = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.157090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:41.157273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.157993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.158979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.159962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.160951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.161969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.162864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.163640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.163735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.163857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.164964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.165961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.166956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.167951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.168906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.169818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.170935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.171958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.172905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.173876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.174835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.175978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.176940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.177997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.178156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.178243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.178393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.178476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.178655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.179951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.180915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.181943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.182893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.external = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.183870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.external = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.password = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.184989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] auth.token = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.password = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.token = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.185979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.186944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.187923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.188981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.189918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.190936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.191985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.192960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.193942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.194823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.195934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.196943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.197931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.198936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.199968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.200920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.201912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.202879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.203998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.204965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.205953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.206973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.207976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.208927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.209795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.210493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.210570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.210707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.210824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.211907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.212860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.213824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.214967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.215927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.216978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.217976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] role.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.218938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] role.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.219898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.220894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.221871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.222957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.223940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.224855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.225035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.225121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.225281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.225359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.225568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.226830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.227857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.228993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.229847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230593 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.230843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.231987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.232834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.connection = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.233861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.234981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.235932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.236975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.237141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.237226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.237377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.237454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:41.237549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:57:41.237626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:57:41.266658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.266800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.266874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.266945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.267122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.267223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.277406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.277515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.306103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.306335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.306568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.306806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.359023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.359455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.409268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.409606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.410002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.410242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.474638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.474778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.474857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.474950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.475483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.476131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.499985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.500803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.511775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.512003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.525988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.526851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:57:41.544503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.544715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:57:41.545028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.545108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.545244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:57:41.545326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:57:41.545519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.545597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.545780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:57:41.545889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.546862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558645 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.558940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.559023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.559226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.565880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.566169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.568928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.569722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.569869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.570046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.570892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.571988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.572148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.572266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.572417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.572538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.595934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.596132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.597417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.597622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.597719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.597932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.602314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.602602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.602683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.602887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.602969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.603195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.609441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.609729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.609810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.610056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.613782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.614098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.614180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.614384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.614479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.614668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.614749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.614948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.615888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.616103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.632362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.632645 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.632727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.632966 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.636783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.636937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.639943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.640081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.640245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.640411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.644602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.644765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.648461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.648576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.651637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.651742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.651942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.652881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.653090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.653179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.668956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.669252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.669334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.669528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.669610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.669795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.669897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.670124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.676606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.677055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.678186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.678469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.678692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.679212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.681384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.681669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.681991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.682073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.682286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.682379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.682568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.682649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.682897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.683177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.693872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.694162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.694974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.695256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.695336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.695534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.695646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.695811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.695937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.696087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.696227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.696515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.696797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.697076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.713395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.714643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.716349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.717582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.719299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.720526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.720862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.722140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.722369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.722654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.722948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.723619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.723913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.724209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.729411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.730676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.731037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.732289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.733962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.734259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.734555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.734837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.735238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.735536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.735827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.736119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.743041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.743336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.743629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.744342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.744684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.744970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.750660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.750902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.751187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.751468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.751746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.751826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:57:41.752021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.752990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.753876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.754067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.754169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.754334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.754448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.754728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.755013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.755286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.755551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:57:41.787881 dv-cinder-master-3-smb devstack@keystone.service[80508]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630f64bc9c0 pid: 80508 (default app) Aug 07 00:57:41.789872 dv-cinder-master-3-smb devstack@keystone.service[80509]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630f64bc9c0 pid: 80509 (default app) Aug 07 00:57:41.791676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d912d-2918-4be4-9ca1-3848eed6d446 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:41.791966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d912d-2918-4be4-9ca1-3848eed6d446 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:41.792243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d912d-2918-4be4-9ca1-3848eed6d446 None None] PATH_INFO: `/v3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:41.796597 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Sun Aug 7 00:57:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:50.535110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:50.535678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:50.535678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:50.540686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:50.545746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:50.546150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:50.546325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:50.616663 dv-cinder-master-3-smb devstack@keystone.service[80508]: INFO dbcounter [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] Registered counter for database keystone Aug 07 00:57:50.635858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG oslo_db.sqlalchemy.engines [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:50.641979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writer thread running {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:50.826948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80508) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:57:50.827288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80508) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:57:50.881993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:50.884120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:51.019657 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 00:57:51.146634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:51.215932 dv-cinder-master-3-smb devstack@keystone.service[80509]: INFO dbcounter [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] Registered counter for database keystone Aug 07 00:57:51.236736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG oslo_db.sqlalchemy.engines [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:51.243613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writer thread running {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:51.361210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837649cd-f3d2-4ae0-b825-a434b0a5f16b None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:51.365485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:51.366133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:51.371868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:51.371868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:51.375598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:51.427095 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:57:51.427384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2e63-197b-4e53-b291-3e7c85078890 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:51.437817 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Sun Aug 7 00:57:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:57:51.443970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:51.458606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83db60e-e0a4-4587-865d-a6f70fa17d1b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:51.463031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:51.464174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:51.464460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:51.464745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] PATH_INFO: `/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:51.466218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d8f722b65514efcbdc7ef3dc7a594c9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:51.516912 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:57:51.517257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5776-2168-46dd-8efe-d6b7165c9356 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:51.521904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Sun Aug 7 00:57:51 2022] GET /identity/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:53.482670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fe66-a890-46fc-bb2a-82fd9aab96b7 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:53.483199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fe66-a890-46fc-bb2a-82fd9aab96b7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:53.483199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fe66-a890-46fc-bb2a-82fd9aab96b7 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:53.487685 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:53.493019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:53.493391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:53.493574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:53.514885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:53.516403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:53.524273 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 00:57:53.546035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6fe66-a890-46fc-bb2a-82fd9aab96b7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:53.557970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6fe66-a890-46fc-bb2a-82fd9aab96b7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:53.562148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:53.562732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:53.563012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:53.563285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:53.571528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:53.573313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e03dc-9bd2-4e95-b3d9-e61252790fbf admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:53.581883 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Sun Aug 7 00:57:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:57:53.588815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:53.597643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27897-b598-4040-9fd0-08cadb882dd6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:53.602104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:53.602718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:53.603000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:53.603275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:53.604578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:53.606435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6e4cc-28b4-4160-b702-7faeb32b041e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:53.607927 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Sun Aug 7 00:57:53 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:55.649543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e6f8-2211-42d1-84d3-b058258d456d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:55.650123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e6f8-2211-42d1-84d3-b058258d456d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:55.650123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e6f8-2211-42d1-84d3-b058258d456d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:55.651638 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:55.656418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:55.656793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:55.657097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:55.667470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f578-1c51-4ddf-91da-90bfeeee64a8 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:55.667763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f578-1c51-4ddf-91da-90bfeeee64a8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:55.668043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f578-1c51-4ddf-91da-90bfeeee64a8 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:55.669344 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:57:55.674494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:55.674781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:55.675060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:55.676279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:55.677475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:55.718323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG passlib.handlers.bcrypt [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80509) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:57:55.718741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG passlib.handlers.bcrypt [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80509) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:57:55.761444 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:57:55.764971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:55.766612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:55.783880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:55.808392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:55.865098 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:57:55.885764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108bd9f-f2a6-4bb9-8903-667717e8ded7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:55.887835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:55.919135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:55.919700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:55.919983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:55.920261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:55.931858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:57:55.940295 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:55.941279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:57:55.942348 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:57:55.947990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:55.996568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eda1a-6087-4a9d-873f-5b9dc61c3d3c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:55.998879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.032396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.034131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.034989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.035268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.035543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.050608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a93b-64ca-4b70-b15c-14c0cd91a4b6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.084768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.085377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.085783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.086094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.086765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:56.087072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.088488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.100219 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:56.103730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.105309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.106484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:56.206430 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:57:56.213597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:56.216806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.315158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6cc75-53a3-4fa9-b194-32b9341a76f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.318965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8d12-50d9-43fc-b285-b59c4557aac7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.348966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.349591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.349899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.350180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.351352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.352950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.353118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.353786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.354094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.354372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.354723 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:57:56 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:56.360070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:56.372774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.374277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.375044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:57:56.392204 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:56.393249 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:57:56.394286 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:57:56.394286 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:57:56.394286 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:57:56.394286 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:57:56.400853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:56.457290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.460852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4031e-d26b-4d17-840e-371d83d39b9f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.494317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.494940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.495220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.495492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.496595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.498070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.499616 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:57:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:56.501103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48ff6-c25d-4f1f-a658-9e2b0cf67896 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.505299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:56.534766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.535370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.535652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.535929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.536573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:56.536880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.538308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a4734-34fd-4bcf-adae-f936059cf321 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.556378 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:56.586159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:56.606616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb766f-5b88-42eb-ba68-f6635a49101b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:56.643392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:56.644011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:56.644290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:56.644565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:56.645295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.domain.id=default, user.id=a7ab3d54af314822bc2df0049ba7e2fb) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:56.645605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:56.647105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491fd0-9cf5-4da6-a4a1-9e3de7c4c853 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:56.655319 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Sun Aug 7 00:57:56 2022] GET /identity/v3/role_assignments?user.id=a7ab3d54af314822bc2df0049ba7e2fb&scope.domain.id=default&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:57:58.992152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a48e-c404-4f91-b75e-7c2e4dfbc939 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:58.992988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a48e-c404-4f91-b75e-7c2e4dfbc939 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:58.993430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a48e-c404-4f91-b75e-7c2e4dfbc939 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:58.994937 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:59.000597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba558-c883-45ff-9ef6-e1a7d9ec3658 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.001359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba558-c883-45ff-9ef6-e1a7d9ec3658 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.001913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba558-c883-45ff-9ef6-e1a7d9ec3658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.006066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914a19-0386-42df-bd53-102680a5962a None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.006894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914a19-0386-42df-bd53-102680a5962a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.008340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914a19-0386-42df-bd53-102680a5962a None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.015283 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:59.016560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.018489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.018904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.045857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a84ba558-c883-45ff-9ef6-e1a7d9ec3658 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:59.045857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a84ba558-c883-45ff-9ef6-e1a7d9ec3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:59.062813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:59.064245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:59.143750 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:57:59.145089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe5e09-f5a8-4cc4-b82c-ee0d81b6eded None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.145377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe5e09-f5a8-4cc4-b82c-ee0d81b6eded None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.145655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe5e09-f5a8-4cc4-b82c-ee0d81b6eded None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.147208 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 13/25] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:59.153051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.153341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.153630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.166205 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:57:59.181046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:59.196202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:59.197426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:59.250269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:59.323835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494db9eb-a96e-4712-a030-ad10600358ae None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:59.344765 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:57:59.346213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:59.354145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:59.395578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:59.396227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.396517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.396794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.415141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:59.417027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:57:59.435792 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:59.436700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:57:59.437475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:57:59.437475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:57:59.437475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:57:59.439268 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:57:59.440798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:59.535882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b9063-04c4-436a-9596-1dbdb7ab0409 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:59.579274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:59.579920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.580206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.580482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.581169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:59.582896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1cc1-bc64-4d19-aeb2-a266490ee9f8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:59.707803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:59.717911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8911ea4-ad2a-4abc-aa23-be787ff0cc35 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:59.753458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:59.754107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.754390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.754663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.767222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:57:59.774417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:59.775259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:57:59.775988 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:57:59.776620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:59.823956 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 15/30] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Aug 7 00:57:59 2022] POST /identity/v3/roles => generated 219 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:57:59.825767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64256c-f701-4562-ab05-72aec5c62131 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.826286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64256c-f701-4562-ab05-72aec5c62131 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.826764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64256c-f701-4562-ab05-72aec5c62131 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.828304 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 16/31] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:59.829391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64256c-f701-4562-ab05-72aec5c62131 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:59.892381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3c368-3da3-4947-b3db-18f3a969f81c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:59.935356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:59.936212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.936492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.938032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.938719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:59.939064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:59.941085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78043371-2964-4b1d-97ba-6a25a43b3d21 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:59.966799 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 16/32] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:59.970464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:59.970970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:59.972089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:59.981392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.003399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:00.005222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:00.021992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.033692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64256c-f701-4562-ab05-72aec5c62131 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.070506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.071370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.071857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.072291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.073106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:00.073578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.075418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.083357 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 17/33] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:00.084188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.085276 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 17/34] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:00.098913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.223618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e2b52-c2a8-4284-ab31-b9256a4d4306 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.242525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e218-2744-46c2-9ea3-c1969cee58c5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.297808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.298899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.299435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.299907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.301031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.303001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.310240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.318972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.318972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.321053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.321347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.323376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.326884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.326884 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 18/35] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:00 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:00.327598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.441437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36451e4-a6e7-44ad-a984-0ee650efa08d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.443089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.477784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.478543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.478837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.479118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.479829 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.481216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263ab8-f1f5-48c4-b37b-7574195112dc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.566416 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 19/36] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Aug 7 00:58:00 2022] POST /identity/v3/roles => generated 225 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:00.578388 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:58:00 2022] POST /identity/v3/projects => generated 301 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:00.578388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.580129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67214-b42b-4a4d-98d6-2a00e9d1799c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.580428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67214-b42b-4a4d-98d6-2a00e9d1799c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.580890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67214-b42b-4a4d-98d6-2a00e9d1799c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.582607 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 20/38] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:00.583554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ab5a-959c-4aed-8bdc-83a887ff2e4c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.583840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ab5a-959c-4aed-8bdc-83a887ff2e4c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.584118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ab5a-959c-4aed-8bdc-83a887ff2e4c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.596567 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 21/39] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:00.598000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864b50f-f0d9-445f-9308-3bc68e781f1d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.598298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864b50f-f0d9-445f-9308-3bc68e781f1d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.598649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864b50f-f0d9-445f-9308-3bc68e781f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.621745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d864b50f-f0d9-445f-9308-3bc68e781f1d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:00.624165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d864b50f-f0d9-445f-9308-3bc68e781f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:00.690144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.713611 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:00.715536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.716183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.716689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.719639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389caed-98d2-4362-a63a-159cab753c00 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.738635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:00.740394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:00.785730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.786457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.786692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.786959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.788176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.790305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.791749 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 19/41] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:00.792272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.829780 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:00.830590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:00.872584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.905566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fb71-3f94-4965-b6ef-7ce905ec90cf None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.930106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f5186-903e-4411-8c91-9af32ecab12a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:00.939654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.940259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.940549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.940836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.941497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.942946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:00.943759 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:00.964136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:00.964798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:00.965084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:00.965367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] PATH_INFO: `/v3/domains/default/users/a7ab3d54af314822bc2df0049ba7e2fb/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:00.967289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7ab3d54af314822bc2df0049ba7e2fb, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:00.968745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:01.031591 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 20/43] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Aug 7 00:58:00 2022] POST /identity/v3/roles => generated 223 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:01.032427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:01.061999 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 24/44] 10.222.0.36 () {58 vars in 1361 bytes} [Sun Aug 7 00:58:00 2022] PUT /identity/v3/domains/default/users/a7ab3d54af314822bc2df0049ba7e2fb/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:01.164471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef2b8-1496-4a7b-8977-5acca991f785 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:01.196112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:01.205361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:01.207625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:01.207625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:01.207625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:01.208004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:01.209556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0876cc9-f4f9-4bd1-b0b1-89aeff8d44dc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:01.211822 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 21/45] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:01.217286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:01.324878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eafa0-76ff-4e90-b7b2-8a5de614086f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:01.358116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:01.358716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:01.358999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:01.359273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:01.359923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:01.361377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6336e3-5cd6-4563-ba0e-01f362e2d819 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:01.438242 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:58:01 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:03.102520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc4121-685b-48c1-a15e-567b5db1f8e5 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.103049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc4121-685b-48c1-a15e-567b5db1f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.103138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc4121-685b-48c1-a15e-567b5db1f8e5 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.104425 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:03.109695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.110125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.110303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.128805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:03.130031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:03.150560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:03.196858 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:03.219407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc4121-685b-48c1-a15e-567b5db1f8e5 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.320036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc4121-685b-48c1-a15e-567b5db1f8e5 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.352753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.353373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.353657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.353972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.363844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-35f75c35-05ec-4064-9836-fce99cc4b185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:03.369198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:03.370056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:03.370796 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 23/49] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:03.377736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.435391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45f2f-1d5d-4fc6-8002-15f53e17dd59 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.435684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45f2f-1d5d-4fc6-8002-15f53e17dd59 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.435968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45f2f-1d5d-4fc6-8002-15f53e17dd59 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.437326 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 24/50] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:03.442102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.442398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.442684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.461615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:03.463182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:03.476462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee883f-2b5d-4fc2-bba5-331251848148 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.509500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.510133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.510415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.510691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.511357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:03.511662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.513068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.513201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:03.521071 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 27/51] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:03.527250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.530202 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 25/52] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:03.546475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:03.552305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.626057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a3b2-29df-4951-b1f5-999d8ace9445 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.650478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0395f5-4d43-45f6-a33d-f94821b271fd None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.659731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.660371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.660661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.660943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.662133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.663601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.665190 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 28/53] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:03.670586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.684158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.684794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.685082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.685362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.686535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.688031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.689601 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 26/54] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:03.695816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.750190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:03.754901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:03.769364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799b72b-3a73-4f10-acb5-9393e2bd5b92 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.793061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58158-4c2d-4a8c-8d3d-d319c4a25830 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.802627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.803261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.803542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.804456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.805313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.806800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.808373 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 29/55] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:03.814283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:03.827743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.828349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.828630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.828901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.829545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.831029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0cb17-0093-4fd3-9370-a7962d19e969 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.912882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c6306-ed94-40f0-b9c0-dc50f900c850 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:03.932544 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 27/56] 10.222.0.36 () {60 vars in 1140 bytes} [Sun Aug 7 00:58:03 2022] POST /identity/v3/projects => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:58:03.947321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:03.947940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:03.948233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:03.948513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:03.949268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.domain.id=default, user.id=a7ab3d54af314822bc2df0049ba7e2fb) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:03.949583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:03.951144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab883-3472-42f4-8959-0531761419d0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:03.958117 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 30/57] 10.222.0.36 () {56 vars in 1322 bytes} [Sun Aug 7 00:58:03 2022] GET /identity/v3/role_assignments?user.id=a7ab3d54af314822bc2df0049ba7e2fb&scope.domain.id=default&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:05.970841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7192-eba4-4795-bba9-7e0e3f2feefc None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:05.971359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7192-eba4-4795-bba9-7e0e3f2feefc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:05.971442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7192-eba4-4795-bba9-7e0e3f2feefc None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:05.972762 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 28/58] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:05.978671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:05.979027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:05.979235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:05.996768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:05.998009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:06.010917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:06.063908 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:06.089150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d7192-eba4-4795-bba9-7e0e3f2feefc None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:06.188890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d7192-eba4-4795-bba9-7e0e3f2feefc None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:06.196435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:06.224733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:06.225341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:06.226479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:06.227144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:06.228335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:06.229846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d2816-2719-4a15-a04d-05694928fd68 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:06.231423 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 29/60] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:06.236986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:06.331563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46674280-c278-4e9c-a22d-f19ab5acdb42 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:06.365302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:06.365929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:06.368353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:06.368353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:06.368353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:06.368593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d340eca-5567-4ec4-803d-dc3f376fe872 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:06.453307 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:06 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:09.558813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893eec4-fe3c-4a95-9c07-279f6dfd2da8 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.559843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893eec4-fe3c-4a95-9c07-279f6dfd2da8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.560323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893eec4-fe3c-4a95-9c07-279f6dfd2da8 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.561968 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 30/62] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:09.567236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470978b-e0d2-4b8c-8e4b-bcf074e1ea52 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.568034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470978b-e0d2-4b8c-8e4b-bcf074e1ea52 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.568518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470978b-e0d2-4b8c-8e4b-bcf074e1ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.578620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:09.594857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7470978b-e0d2-4b8c-8e4b-bcf074e1ea52 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:09.596063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7470978b-e0d2-4b8c-8e4b-bcf074e1ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:09.692161 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 33/63] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:09.703482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcdc9-b1f9-4fff-8879-af75439e71dc None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.704049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcdc9-b1f9-4fff-8879-af75439e71dc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.704522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dcdc9-b1f9-4fff-8879-af75439e71dc None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.706081 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 31/64] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:09.712109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137202a-dadf-4e9d-939b-52194f404064 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.712407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137202a-dadf-4e9d-939b-52194f404064 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.712695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137202a-dadf-4e9d-939b-52194f404064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.720899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dcdc9-b1f9-4fff-8879-af75439e71dc None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:09.737865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3137202a-dadf-4e9d-939b-52194f404064 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:09.737865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3137202a-dadf-4e9d-939b-52194f404064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:09.840303 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:09.859546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215cf5f-eebf-49c3-9ba9-05d2da69c2e8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.860350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215cf5f-eebf-49c3-9ba9-05d2da69c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.860777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215cf5f-eebf-49c3-9ba9-05d2da69c2e8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.862612 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 35/66] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:09.864314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215cf5f-eebf-49c3-9ba9-05d2da69c2e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:09.897136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dcdc9-b1f9-4fff-8879-af75439e71dc None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:09.940374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:09.941253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.941685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.942158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.949343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:09.955185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-acb20004-ead9-4226-a6e3-e94c291adb81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:09.961142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:09.966839 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 32/67] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:09.967607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:09.968273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:09.968273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:09.991692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:09.993534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:09.997907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215cf5f-eebf-49c3-9ba9-05d2da69c2e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.026524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.042529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.043171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.043456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.043735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.055143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:10.059999 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:10.062322 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 36/68] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:10.064446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.079075 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 33/69] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:10.082963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.187451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11e266-e3b6-4c98-9953-07a5a2170a8b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.193805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ec49-bc3f-4bc2-9c31-c27afaea6fd2 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.212641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.222944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.223559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.223833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.224108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.224774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:10.225094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.226651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a7de2-26d8-4b0b-a936-a1a97efd2d31 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.232690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.233512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.233998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.234449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.234609 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 37/70] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:10.235584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:10.236071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.237673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.240182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1865-8562-4525-b6b7-28398ff75c48 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.240472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1865-8562-4525-b6b7-28398ff75c48 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.240753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1865-8562-4525-b6b7-28398ff75c48 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.242361 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 38/71] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:10.243377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1865-8562-4525-b6b7-28398ff75c48 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.253072 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 34/72] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:10.253942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.286763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.357694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1865-8562-4525-b6b7-28398ff75c48 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.362051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028422da-ae56-4374-8416-de06bbff6865 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.390946 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.391571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.391857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.392138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.396665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.397962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.398393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.398685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.400093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.401563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbd0bc-87c0-49e0-a864-5bbacb7db3a7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.403190 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 35/73] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:10.407672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5dca2-8c6a-4454-bfb2-d47a61e925ac None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.407672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5dca2-8c6a-4454-bfb2-d47a61e925ac None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.407807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:10.407876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5dca2-8c6a-4454-bfb2-d47a61e925ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:10.409922 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:10.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:10.411475 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 39/74] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:10.412099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.428238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-26c5dca2-8c6a-4454-bfb2-d47a61e925ac None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:10.429655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-26c5dca2-8c6a-4454-bfb2-d47a61e925ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:10.458216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.496828 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 36/75] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:10.498166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543710-03e0-46a5-be0b-edf02a7ab160 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.498459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543710-03e0-46a5-be0b-edf02a7ab160 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.498738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543710-03e0-46a5-be0b-edf02a7ab160 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.500137 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 37/76] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:10.500683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543710-03e0-46a5-be0b-edf02a7ab160 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.512089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da1d3-82f5-4367-ac34-75d8c59e173f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.526586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.545914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.546539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.546832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.547155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.560717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.562251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.563892 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 40/77] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:10.564653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.608359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543710-03e0-46a5-be0b-edf02a7ab160 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.641626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.642256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.642541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.642813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.662598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0505-3344-46b4-9362-e4c625d368ba None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.665648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.697053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.698061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.698344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.698625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.699279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:10.699580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.700965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7194a-36d8-4ac4-a85f-28200601c231 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.709892 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 41/78] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:10.710121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.710410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.710689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.715693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.717182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.727342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:10.728530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:10.740389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.793720 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 42/79] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:10.794595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.826511 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 38/80] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:10.827366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.889643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.895443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616f03-0f72-4a29-979c-2d5b701a9239 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.924860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c827c-7456-47ca-80f3-c2ca14de9499 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.931368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.931997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.932282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.932559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.942365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:10.947124 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:10.947988 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:10.948734 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 43/81] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:10.950523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.950629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.959530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.963358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.963358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.963358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.033065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.034581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.049294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7d40-c43c-4455-9079-271a0ab6457a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.083359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.083982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.084269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.084552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.085741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.087234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.088985 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 44/82] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.089562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.118603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.132254 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 39/83] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:11.133088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.157114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.196826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678fd37-0dc1-4639-a19d-c6d5f4d16a2a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.229480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af598eb-48a0-4314-8eee-1448db3a2491 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.230802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.231432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.231718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.231997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.233104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.234584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.236153 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 45/84] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.240921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.267193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.267815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.268095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.268369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.269481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.270968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.273187 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 40/85] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.273960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.324495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.333432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffed8-d842-4680-a9c7-a791b4fbb582 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.363441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.367691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.368301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.368585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.368865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.369528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:11.378016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.378016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.378244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ed9ef-b9ee-463c-84f3-60f77519d001 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.379021 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 46/86] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.379804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.405462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.406109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.406396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.406671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.473768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.475469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.477669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52144-db5f-47c5-9203-13e10330a954 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.510716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.511262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.511543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.511819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.512931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.514402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.516024 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 47/87] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.520892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.542297 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.567776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.577376 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 41/88] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:11.578337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.616639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda04e-3d55-4b56-850b-412ce5dbf3bf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.650916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.651526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.651815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.652094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.652745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.654247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.675206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d99926-c7a8-4ac0-90d5-065a1453cb73 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.708595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.709188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.709625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.709903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.710658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=a7ab3d54af314822bc2df0049ba7e2fb) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:11.710990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.712450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.720393 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 42/89] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/role_assignments?user.id=a7ab3d54af314822bc2df0049ba7e2fb&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.721204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.781672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.802335 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 48/90] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:11 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:11.804109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.843770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db969d-c3c3-479c-8dd5-d95be23abfdd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:11.896319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:11.898025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:11.898624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:11.899106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:11.900831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:11.902997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:11.905090 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 43/91] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:11.910952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:11.929105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:11.958361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22c21-ef29-4d0c-9d9b-e1e55923f24b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.059727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.060043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7af5-4d7f-403f-828f-279aacb987b3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.060280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.060570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.060850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.061600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:12.062702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.064181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.070410 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 49/92] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:12.071264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:12.098090 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:12.114359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.115509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.116371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.117117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.118406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.120191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.123113 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 44/93] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:11 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:12.130175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:12.211244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364dc4-65e2-4a2e-95fc-2622868a8857 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.260868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.262139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.262423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.262706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.277048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71d98-69e1-4698-8a6c-fb3f323da720 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.280049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:12.323307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.323862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.324146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.324430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.325170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:12.325517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.327005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.333260 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 45/94] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:12 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:12.343181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.344776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.463172 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 50/95] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:12.469043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:12.540160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:12.601956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae72a8-cd24-47d8-9504-1d8c37b647bd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.647981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.648729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.649021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.649310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] PATH_INFO: `/v3/projects/daab6f79159d42aeb27914f9f8d01b74` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.651617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] RBAC: Authorizing `identity:get_project(project_id=daab6f79159d42aeb27914f9f8d01b74)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.653119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453951-642e-4886-84b2-9312930e4560 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.655029 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 46/96] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:12 2022] GET /identity/v3/projects/daab6f79159d42aeb27914f9f8d01b74 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:12.660785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:12.719934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:12.779175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64d24-6054-4034-9d17-158348c636a6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:12.814381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:12.815134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.815286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.815572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.816303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=daab6f79159d42aeb27914f9f8d01b74, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:12.816619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:12.818105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebc1ed-409f-4e67-a70a-f5f541db4e99 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:12.824907 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 51/97] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:12 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=daab6f79159d42aeb27914f9f8d01b74&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:14.493086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e6b7-ac7d-4b81-8041-1e62aad4e167 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:14.493586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e6b7-ac7d-4b81-8041-1e62aad4e167 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:14.493658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e6b7-ac7d-4b81-8041-1e62aad4e167 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:14.495195 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 47/98] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:14.500195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:14.500576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:14.500764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:14.526976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:14.528300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:14.616869 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 52/99] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:14.649622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e6b7-ac7d-4b81-8041-1e62aad4e167 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:14.775017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e6b7-ac7d-4b81-8041-1e62aad4e167 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:14.799524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:14.810937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:14.811568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:14.811848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:14.812125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:14.822972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-83397f79-798f-45c9-8c7b-f0fa5f0a5a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:14.827796 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:14.828629 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:14.829972 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 48/100] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:14.836184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:14.872752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cad0-babb-4f22-87ee-e5079b9d37f6 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:14.873071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cad0-babb-4f22-87ee-e5079b9d37f6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:14.873308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cad0-babb-4f22-87ee-e5079b9d37f6 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:14.875164 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 49/101] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:14.881356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:14.881795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:14.882154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:14.903142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:14.903470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:14.905190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:14.995838 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 50/102] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:15.030630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.152627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6d29-eb6f-43e2-83ed-d158785f191c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.156156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ac306-44cd-43bc-9a90-76acba5dd2ec None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.171383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.197907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.198908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.199399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.200772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.203226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.204900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:15.206920 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:15.214973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.229333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.230212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.230641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.231051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.231866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:15.232344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.233920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:15.251110 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:15.257322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.330060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6defb4-56dc-478a-8e31-40997529caf4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.410482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.411105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.411395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.411679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.412348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.414651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad1d32-94a4-4c23-94af-303333b3bb7c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:15.426201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.432698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895991-e4ee-4061-98e4-eb7d81b15a68 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.483421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.484075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.484364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.484646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.485974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.487546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82f367-af5d-4c61-a890-8dfd6c7f49e9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:15.489621 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 54/105] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:15.491395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220a637-8d26-4280-8a74-9ad6e76ec92a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.491686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220a637-8d26-4280-8a74-9ad6e76ec92a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.491965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220a637-8d26-4280-8a74-9ad6e76ec92a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.493449 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 55/106] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.497633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220a637-8d26-4280-8a74-9ad6e76ec92a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.515587 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 52/107] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:15.516886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944ad9e-ac9e-4da9-9007-529e560d23ab None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.517241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944ad9e-ac9e-4da9-9007-529e560d23ab None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.517528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944ad9e-ac9e-4da9-9007-529e560d23ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.549692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a944ad9e-ac9e-4da9-9007-529e560d23ab None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:15.551115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a944ad9e-ac9e-4da9-9007-529e560d23ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.605430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.634091 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 53/108] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:15.639815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5daa8-cad8-40e1-8497-1d8b510755f4 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.644262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5daa8-cad8-40e1-8497-1d8b510755f4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.644709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5daa8-cad8-40e1-8497-1d8b510755f4 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.646291 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 54/109] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.648348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602052-3bd6-42fe-8fac-999aac5481ec None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.648728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602052-3bd6-42fe-8fac-999aac5481ec None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.649175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602052-3bd6-42fe-8fac-999aac5481ec None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.650448 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 55/110] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.654913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004821-966d-4612-850c-b12f17727b78 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.655210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004821-966d-4612-850c-b12f17727b78 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.656494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40004821-966d-4612-850c-b12f17727b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.687028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220a637-8d26-4280-8a74-9ad6e76ec92a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.690355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-40004821-966d-4612-850c-b12f17727b78 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:15.691654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-40004821-966d-4612-850c-b12f17727b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.728492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.729144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.729491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.729716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.731530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.732331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d98c-6823-41ac-9436-2777e480220c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:15.734503 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:15.736103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f534b-052e-4eab-b985-ed92819e545d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.736103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f534b-052e-4eab-b985-ed92819e545d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.736103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f534b-052e-4eab-b985-ed92819e545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.758165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-790f534b-052e-4eab-b985-ed92819e545d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:15.759378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-790f534b-052e-4eab-b985-ed92819e545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.774804 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:15.774804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40004821-966d-4612-850c-b12f17727b78 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.791246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.838916 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 57/113] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:15.839754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f534b-052e-4eab-b985-ed92819e545d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.890111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.898195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40004821-966d-4612-850c-b12f17727b78 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.936964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.937600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.937921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.938205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.949602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:15.951983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f534b-052e-4eab-b985-ed92819e545d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-d57a29b4-3eee-4642-bbb4-302bc7017db4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:15.954895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:15.955813 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:15.956577 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:15.957487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7a48-e155-42b9-8234-fd4908ea856c None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.957487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7a48-e155-42b9-8234-fd4908ea856c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.957487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7a48-e155-42b9-8234-fd4908ea856c None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.959098 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 58/115] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.959816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7a48-e155-42b9-8234-fd4908ea856c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.003051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.003724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.004010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.004287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/a7ab3d54af314822bc2df0049ba7e2fb/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.006867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, user_id=a7ab3d54af314822bc2df0049ba7e2fb, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.008721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.068692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7a48-e155-42b9-8234-fd4908ea856c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.079364 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:15 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/a7ab3d54af314822bc2df0049ba7e2fb/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:16.080639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.114886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.122652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.123312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.123612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.123888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.139682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:16.146936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:16.148242 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:16.149034 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:16.151605 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:16.158368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.178738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.227471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6b81-cb13-40e8-8c9b-6e48001fce50 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.272761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.273411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.273700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.274013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.286048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1be02084-7de8-414e-baa5-6abdac264555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:16.291600 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:16.292459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:16.293250 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:16.293955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.294374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.294495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.302543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269bad7-a05a-4b78-b672-b83f029a0c99 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.312433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:16.313652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:16.342590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.343568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.344083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.344655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.345618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:16.346151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.347846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.358268 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.359465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.399594 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 60/120] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:16.400264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.418896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.450529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.479084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9fe1-77e9-4773-a31f-f4b2015d4f6a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.522781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.524323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.524682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc123-a222-4683-8d8a-bc0d48438456 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.525055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.525621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.526626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:16.527184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.528779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.543967 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.545217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.568640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.569331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.569620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.569936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.570610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:16.570920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.572779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.584909 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.585614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.660222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07725f-fd4a-4641-b1c6-16786a635717 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.695945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.700137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.701097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.701638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.702179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.703555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.705372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.707532 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.713625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.721105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b49ab-1022-4f18-bfcf-5b7a66cdc3d5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.724664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.768014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.768653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.768943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.769379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.782902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:16.790393 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:16.791307 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:16.792076 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 62/124] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:16.792712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.848853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ced8-abaa-4333-9b3e-d71befb36cdf None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.897127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.897759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.898088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.898371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.900302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.901755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.906268 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.906880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.920473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32219e5-1d1e-4b87-b2f1-5d1be243b24e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.958574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.959649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.960139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.960618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.962188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.963884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.971951 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:16.971951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.971951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.985710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:17.011560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cd4c-3096-42c8-b621-26ab98f0cd0c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.045692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.046396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.046685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.047013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.048165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.049611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.053877 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:17.053877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.105538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c168f7-f474-4470-9225-79766d4a3da5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.153644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.154669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.155428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.156349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.157497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:17.158037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.160187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.173219 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:17.174598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.175746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7357a9-712b-40f1-a0bd-808b18eb13df None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.224190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.225816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.226459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.227102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.228547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.231146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.233985 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:17 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:17.235252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.252980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:17.258242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:17.294258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8649-4c86-42ae-8dfd-cd69314bb438 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.336756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.337663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.338138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.338560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] PATH_INFO: `/v3/projects/daab6f79159d42aeb27914f9f8d01b74` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.339849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] RBAC: Authorizing `identity:get_project(project_id=daab6f79159d42aeb27914f9f8d01b74)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.341659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.343644 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 65/130] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:17 2022] GET /identity/v3/projects/daab6f79159d42aeb27914f9f8d01b74 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:17.344651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.372236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7989367-fab3-494f-bfa8-86510b2093b7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.417371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.419116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.419598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.419885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/328b6fbc889c46839ffd48ac0a909219/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.422960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, user_id=328b6fbc889c46839ffd48ac0a909219, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.424547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.461623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cb8b-2273-4070-9d14-5e68c924d43e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.499001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.499828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.500259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.500682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] PATH_INFO: `/v3/users/b799db05d6fb4a05b47a316538aaa98a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.502940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:17.516011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] RBAC: Authorizing `identity:get_user(user_id=b799db05d6fb4a05b47a316538aaa98a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.517614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.519541 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:17 2022] GET /identity/v3/users/b799db05d6fb4a05b47a316538aaa98a => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:17.520157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.532451 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 66/132] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:17 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/328b6fbc889c46839ffd48ac0a909219/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:17.542589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.652109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:17.691346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5ddb-6928-40d5-89cb-e47c90014a91 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.730720 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.731639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.732073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.732460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] PATH_INFO: `/v3/projects/daab6f79159d42aeb27914f9f8d01b74/users/328b6fbc889c46839ffd48ac0a909219/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.734459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f70d-4d33-4536-9213-d0d1e6ad0f17 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.734918 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=daab6f79159d42aeb27914f9f8d01b74, user_id=328b6fbc889c46839ffd48ac0a909219, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.736744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.776120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:17.776800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.777095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.777376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/328b6fbc889c46839ffd48ac0a909219/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.779654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, user_id=328b6fbc889c46839ffd48ac0a909219, role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:17.781123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f4efd-c811-4741-9aac-c28d558754cb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:17.802533 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 67/133] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:17 2022] PUT /identity/v3/projects/daab6f79159d42aeb27914f9f8d01b74/users/328b6fbc889c46839ffd48ac0a909219/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:17.804561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:17.890485 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:17 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/328b6fbc889c46839ffd48ac0a909219/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:17.897961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b666-85af-4b5c-8f97-5e996092ba65 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.898837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b666-85af-4b5c-8f97-5e996092ba65 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.899330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b666-85af-4b5c-8f97-5e996092ba65 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.901164 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 68/135] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:17.907292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:17.907787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:17.908283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:17.946672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:17.950031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994532e-b540-4fbe-8cba-a0778f1682b4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:17.951818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:17.996335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.005007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.005747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.006182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.006512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.029800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.061789 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 69/136] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:18.107869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.109518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.109787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.320544 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 68/137] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:18.327311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.331912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b407d-c1bf-4965-8509-08413e7b8035 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.383886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.405934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.408648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.410231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.410231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.412792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.417089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ba0d2-58dc-41d1-afc3-514600c26953 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.420053 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 70/138] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:18.422670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539ecf-6565-443c-9af5-5cb06a1c0471 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.425314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539ecf-6565-443c-9af5-5cb06a1c0471 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.425744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7539ecf-6565-443c-9af5-5cb06a1c0471 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.427689 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 71/139] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:18.431132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7539ecf-6565-443c-9af5-5cb06a1c0471 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.500381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.500851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ddd7-bbe8-457d-adf8-d76c75cdb94f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.562071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7539ecf-6565-443c-9af5-5cb06a1c0471 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.572361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.572941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.573232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.573515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.576543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.578040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c9634-d468-43be-bfd3-a8e398307617 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.580012 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 69/140] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:18 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:18.581131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.581422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.581706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.601952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.602944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.603490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.603902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.604677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.606317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.626440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:18.627921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:18.698966 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 70/141] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:18.700040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.733443 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 72/142] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:18 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:18.755622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.756721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.877472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6c917-2e8b-42f6-9816-84b782dd1558 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.915812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.916413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.916697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.916975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.917845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=b799db05d6fb4a05b47a316538aaa98a) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:18.918160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.919846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.926457 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 71/143] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:18 2022] GET /identity/v3/role_assignments?user.id=b799db05d6fb4a05b47a316538aaa98a&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=91089ca872694116b4cc806ad5ade921 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:18.960779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825d57-be37-4a5c-b186-88ba4685a48e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.974166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.025425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:19.026473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.026906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.027337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.047983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:19.053044 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:19.054187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:19.055422 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 73/144] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:19.060736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:19.201113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.212174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e230c-ef2f-4b0c-a1bd-0e6d6d6d768b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:19.253380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:19.254028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.254322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.254603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.255292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:19.255607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:19.258218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:19.269357 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 72/145] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:19.275529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:19.389062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465fa9-6b79-4375-88f2-3a6a5d934d2b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:19.425162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:19.425799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.426115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.426401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] PATH_INFO: `/v3/users/a7ab3d54af314822bc2df0049ba7e2fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.427544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ab3d54af314822bc2df0049ba7e2fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:19.429948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:19.431792 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 74/146] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:19 2022] GET /identity/v3/users/a7ab3d54af314822bc2df0049ba7e2fb => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:19.437314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:19.557674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4cee2-9010-4d01-abc2-a2f1bac3d32b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:19.599903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:19.600927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.601224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.601509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.633178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.683930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:19.685432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:19.802518 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 73/147] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:19.809256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:19.860816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.942111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad9c52-9f4d-4a54-8fb6-e4efee1fd793 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:20.003167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:20.004202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.004694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.005172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.006897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:20.008580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542f3b-6f43-4cd8-b105-353fb14a885b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:20.010801 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 75/148] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:19 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:20.016604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:20.102001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:20.161947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cefdf-9123-4813-ba3b-0b438b0a4c83 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:20.209364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:20.210489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.210781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.211062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.211812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=a7ab3d54af314822bc2df0049ba7e2fb) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:20.212129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:20.213594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cbaeb-03b3-493e-b015-9f1b2fd084ad None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:20.222888 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 74/149] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:20 2022] GET /identity/v3/role_assignments?user.id=a7ab3d54af314822bc2df0049ba7e2fb&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:20.272719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79fac-b9bd-495b-b4d8-b73e60d9c719 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.273332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79fac-b9bd-495b-b4d8-b73e60d9c719 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.273812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79fac-b9bd-495b-b4d8-b73e60d9c719 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.275391 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 76/150] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:20.280784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0943-c848-4d4b-8c2c-fb8310f857f7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.281065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0943-c848-4d4b-8c2c-fb8310f857f7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.281433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0943-c848-4d4b-8c2c-fb8310f857f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.315023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c99a0943-c848-4d4b-8c2c-fb8310f857f7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:20.316290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c99a0943-c848-4d4b-8c2c-fb8310f857f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:20.397044 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 75/151] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:20.421640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79fac-b9bd-495b-b4d8-b73e60d9c719 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:20.442469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785e6d0-36a4-4731-9caf-2bf235f4ebcb None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.442827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785e6d0-36a4-4731-9caf-2bf235f4ebcb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.443113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785e6d0-36a4-4731-9caf-2bf235f4ebcb None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.445186 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 76/152] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:20.450770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.451062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.451343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.481181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:20.482458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:20.558859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:20.603333 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 77/153] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:20.627673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79fac-b9bd-495b-b4d8-b73e60d9c719 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:20.629714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:20.645035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:20.678009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:20.679625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.680131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.680615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.703478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:20.708904 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:20.710598 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:20.711383 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:20.713583 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 77/154] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:20.719669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:20.802629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875aeb5-39ea-4a6b-8d16-6b6f30b64d2f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:20.858595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:20.859250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:20.859539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:20.859817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:20.875248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:20.880036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:20.881611 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:20.882490 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 78/155] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:20.887762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:20.949491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:20.950130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1320b9-1a5b-484f-86fe-fcbbc6595155 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.037112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722f319-633d-4138-b748-e9af9e85c512 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.049012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.049638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.049949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.050229 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.050908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:21.051322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.053247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.065597 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:21.071945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:21.091131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.091754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.092030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.092301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.092975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:21.093281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.094711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.104695 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 79/157] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:21.109840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:21.124039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:21.241899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ac07d-6277-4aa0-bd8e-695bfb0421ba None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.243409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:21.276166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534162f2-97db-4b24-9fc5-c26bb820174b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.303123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.303771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.304073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.304325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.310553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.312018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.313823 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 80/158] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:21 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:21.319562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:21.347643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.348287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.348568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.348845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.350708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.352359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.362176 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 79/159] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:21 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:21.369096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:21.485949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98604-93f9-463c-89f1-1704846910e1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.559682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.560213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.560493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.560767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.587880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:21.605368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c7cd2-9a34-4602-89c7-1fd6d5d37c01 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:21.622391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:21.674868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:21.676069 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.676356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.676631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.690661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.692226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a30a61-9860-4415-b86b-78844c48b6ad None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.798306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:21.799930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:21.910999 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 81/160] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:21.913407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db302ed-2b99-4b86-96a5-37326376fd68 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.913696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db302ed-2b99-4b86-96a5-37326376fd68 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.914004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db302ed-2b99-4b86-96a5-37326376fd68 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.915636 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 82/161] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:21.920711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:21.921176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:21.921461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:21.955845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:21.957311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:22.022243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.048488 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 80/162] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:22.049347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.066892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.073619 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 83/163] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:22.074484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.242670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccd70-a599-4546-8c89-7d18171ff9f7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.253522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8800-eb0a-4680-9bf8-6318bc071878 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.307358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.308000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.308288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.308566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] PATH_INFO: `/v3/projects/daab6f79159d42aeb27914f9f8d01b74` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.310138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] RBAC: Authorizing `identity:get_project(project_id=daab6f79159d42aeb27914f9f8d01b74)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:22.311610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:22.313258 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 81/164] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/projects/daab6f79159d42aeb27914f9f8d01b74 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:22.315002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.320316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.320956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.321238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.321516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.323364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:22.324874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:22.326542 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 84/165] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:22.327299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.395157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.414263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.463760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d7943-b3cb-40cc-9133-1c6695e10b57 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.483492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f1da0-cec1-4670-9c17-555796c4e472 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.529948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.530516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.530796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.531075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.542544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.543160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.543446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.543729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.544467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=daab6f79159d42aeb27914f9f8d01b74, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:22.544779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:22.546252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb868-1316-4d69-8c21-9d06ee91671a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:22.554160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:22.558924 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:22.559821 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 82/166] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:22.560799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.571589 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 85/167] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=daab6f79159d42aeb27914f9f8d01b74&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:22.572834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b31f-fcfa-4c4c-b11b-3002875d9a2f None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.573127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b31f-fcfa-4c4c-b11b-3002875d9a2f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.573408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7b31f-fcfa-4c4c-b11b-3002875d9a2f None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.577122 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 86/168] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:22.584965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.585450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.585738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.631575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:22.633866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:22.795826 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 87/169] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:22.797075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.829821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab942-faa6-48a5-970e-5ea9c5491c43 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.855517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.876714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.877323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.886487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.886487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.886487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:22.886487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:22.886487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:22.898812 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 83/170] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:22.899731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.918034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.996671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5061ce-3661-45a7-9d00-5701516c8d17 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.071238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.071785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.072068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.072347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.073040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:23.073350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.074809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.096891 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 88/171] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:23.103464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.119711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519b19-9227-4f41-b23c-dbfd72af118b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.179027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.179733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.180019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.180292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.193764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:23.204002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:23.204918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:23.205724 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 84/172] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:23.212005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.268172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.276854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e12d-8103-41a8-9cff-a95840715984 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.301490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.317873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.321820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.321820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.321820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] PATH_INFO: `/v3/users/328b6fbc889c46839ffd48ac0a909219` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.325289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] RBAC: Authorizing `identity:get_user(user_id=328b6fbc889c46839ffd48ac0a909219)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.326808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.334376 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 89/173] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/users/328b6fbc889c46839ffd48ac0a909219 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:23.338117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a7e6-1ca6-4f09-bedf-9493d1ce5f01 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.339776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.394333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.394950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.395232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.395507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.396181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:23.396679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.398548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064b6c-4c8b-4618-8de8-7fdc48ec6691 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.411713 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 85/174] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:23.413398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd235-c404-4921-8160-1a97fdd3da05 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.413690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd235-c404-4921-8160-1a97fdd3da05 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.414042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd235-c404-4921-8160-1a97fdd3da05 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.415803 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 86/175] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:23.421088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.421369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.421653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.440566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:23.441789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:23.492983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447acfa-4fa3-4ff4-a806-34e3768ee34b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.533857 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 87/176] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:23.533857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.539201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.539949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.540316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.540624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.575327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.603397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.613616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.615735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.646090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee0ff-9c3d-40cb-b287-a660573cdba1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.682099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.682854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.682997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.683271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] PATH_INFO: `/v3/users/b799db05d6fb4a05b47a316538aaa98a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.684402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] RBAC: Authorizing `identity:get_user(user_id=b799db05d6fb4a05b47a316538aaa98a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.686127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40952cb2-dc75-45b7-b1b1-7cb28e4accc2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 88/177] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/users/b799db05d6fb4a05b47a316538aaa98a => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae11b-8a0b-44b4-8741-ec0222a9d2c1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae11b-8a0b-44b4-8741-ec0222a9d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae11b-8a0b-44b4-8741-ec0222a9d2c1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 89/178] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:23.692151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae11b-8a0b-44b4-8741-ec0222a9d2c1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.720559 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 90/179] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:23.720559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.799471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae11b-8a0b-44b4-8741-ec0222a9d2c1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.802005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.814971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:23.824940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea078e8-6a59-401c-bbdd-215fd498de15 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:23.832979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.833541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.834926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.834926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.844440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4e5c6567-5696-4383-acbf-ae1e1c3ea93a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:23.849187 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:23.855565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 90/180] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:23.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a12f2-36c2-49e2-9f1c-13fae59a12cd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.857157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a12f2-36c2-49e2-9f1c-13fae59a12cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.857157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a12f2-36c2-49e2-9f1c-13fae59a12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.861910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:23.862543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.862829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.863106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.864232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:23.866462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:23.868206 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 91/181] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:23.868964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.869458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8f9a12f2-36c2-49e2-9f1c-13fae59a12cd None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:23.870658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8f9a12f2-36c2-49e2-9f1c-13fae59a12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:23.936818 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 91/182] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:23.938103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed11f4-9184-4290-8e6e-a2dc5e22b4fe None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:23.938392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed11f4-9184-4290-8e6e-a2dc5e22b4fe None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:23.938670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed11f4-9184-4290-8e6e-a2dc5e22b4fe None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:23.940041 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 92/183] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:23.940615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed11f4-9184-4290-8e6e-a2dc5e22b4fe None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:23.981886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae651-0147-40d5-85a2-e7eb44d2af89 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.015978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.016610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.016897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.017172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.018316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.019775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.021958 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 92/184] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.022749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.040476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.047909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed11f4-9184-4290-8e6e-a2dc5e22b4fe None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.050535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.081285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.081918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.082476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.082737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.083483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:24.084276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.085774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c67c3-5a9e-4b01-851c-869cb9a8cce0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.093666 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 93/185] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.094873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.095157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.095428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.112959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:24.114172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:24.123021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb790-9b2a-4083-9442-bf1dd41b0f87 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.156173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.156828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.157113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.157394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/b799db05d6fb4a05b47a316538aaa98a/roles/91089ca872694116b4cc806ad5ade921` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.159345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, user_id=b799db05d6fb4a05b47a316538aaa98a, role_id=91089ca872694116b4cc806ad5ade921)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.160784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.179230 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 94/186] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:24.180324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.218466 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 93/187] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:24 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/users/b799db05d6fb4a05b47a316538aaa98a/roles/91089ca872694116b4cc806ad5ade921 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:24.219333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.266815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.282640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d47c1-c21a-476f-86ab-3c515673af01 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.323622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.324269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.324552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.324894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.335609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.337499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:24.342471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:24.343613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 95/188] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:24.344532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.355481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291238-6a17-46cd-9d53-b883805a6f0f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.398519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf980-434a-447a-9468-094cc6348380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.399251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf980-434a-447a-9468-094cc6348380 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.399533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf980-434a-447a-9468-094cc6348380 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.399813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf980-434a-447a-9468-094cc6348380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.400612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf980-434a-447a-9468-094cc6348380 None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=328b6fbc889c46839ffd48ac0a909219) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:24.400927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf980-434a-447a-9468-094cc6348380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.402545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf980-434a-447a-9468-094cc6348380 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.408768 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 94/189] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/role_assignments?user.id=328b6fbc889c46839ffd48ac0a909219&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.409683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf980-434a-447a-9468-094cc6348380 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.487942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981d6eb-a941-4aaf-ae94-c17f2f4c6977 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.537726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.538286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.538565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.539100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.547293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf980-434a-447a-9468-094cc6348380 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.559382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.561566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.564144 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 96/190] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.564959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.571681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.602503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.603194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.603477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.603926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.604847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.606382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.608352 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 95/191] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.608870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.637183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.711839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874daa4-6d38-45fb-b46e-e1f31087cc79 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.740639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dbaba-2e18-4499-aab7-6377ae3eb75d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.747394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.748047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.748333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.748609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.749276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:24.749582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.750987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.759896 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 97/192] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:24.760508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:24.780866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.781468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.781745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.782060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.829954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.860360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.860360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.868192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45b815-b2c8-46b7-a692-a1bdbf190037 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:24.873016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:24.904474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:24.905448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:24.905976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:24.906455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:24.907314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:24.908970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:24.959017 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 96/193] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:24.960442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.033864 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 98/194] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:24 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:25.033864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.076763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a2bf-16e0-4f8b-b6de-acdd7d94f873 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.098201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.118445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.119013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.119361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.119637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.120882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.122411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.124121 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 97/195] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:24 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:25.130118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.180235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d61f-436a-43a7-8689-9a81157c4e6e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.209904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.227775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.228578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.228915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.229912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.231936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.233569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.236040 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 99/196] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:25.242707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.277529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6c9ca-76db-4106-9285-914c73489830 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.323382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.324238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.324520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.324791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.370312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b27b2-fe22-4354-b8fd-3f9ff293aeb3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.406188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.417362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.418035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.418344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.424522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.424522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=248726433a034042af1715625b10f7dd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:25.424522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.424522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.426244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.427798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.428227 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 100/197] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/role_assignments?user.id=248726433a034042af1715625b10f7dd&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:25.554233 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 98/198] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:25.559763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.641885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.693426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e23146-85ad-4213-93bd-ec8261815fba None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.733284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.734331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.734785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.735231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.736563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.738216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b413e0-2172-4e9b-b968-e6710ff20080 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.740879 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 101/199] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:25.747085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.881560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.903305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a597-c71c-404f-9904-2c9f5c31fdec None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:25.948361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:25.948977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.949257 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.949531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.954208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=248726433a034042af1715625b10f7dd) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:25.954531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:25.956023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362866-b574-41d9-8f0b-e4dfdadf08f1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:25.962311 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 99/200] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/role_assignments?user.id=248726433a034042af1715625b10f7dd&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:26.571821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48540-79cf-4181-adfa-6739ce139256 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:26.572337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48540-79cf-4181-adfa-6739ce139256 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:26.572446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48540-79cf-4181-adfa-6739ce139256 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:26.574024 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 102/201] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:26.579494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:26.579790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:26.580074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:26.598483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:26.600205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:26.679392 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 100/202] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:26.727370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48540-79cf-4181-adfa-6739ce139256 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:26.868718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48540-79cf-4181-adfa-6739ce139256 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:26.908161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:26.915885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:26.916519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:26.916801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:26.917077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:26.933384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:26.938180 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:26.939036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:26.939892 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 103/203] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:26.946515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:27.057796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:27.077451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569cecd-eebd-49b0-b40f-742e5c79c901 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:27.133407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:27.134012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.134300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.134578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.135305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:27.135619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:27.137011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:27.151415 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 101/204] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:27.156904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:27.279993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081cdcf-31c4-4a1a-891b-ff438d30f72c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:27.332649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:27.333286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.333674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.333994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] PATH_INFO: `/v3/users/b799db05d6fb4a05b47a316538aaa98a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.338519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b799db05d6fb4a05b47a316538aaa98a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:27.339980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30023c5-2331-4154-bfe4-a598f72ce9a2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:27.341944 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 104/205] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:27 2022] GET /identity/v3/users/b799db05d6fb4a05b47a316538aaa98a => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:27.347519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:27.505545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d945-4737-42bc-a504-65aa916ba3ff None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:27.547931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:27.548606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.548897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.549173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.570396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:27.596376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d28-4f38-4d6e-8030-ae75b18f2dbd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.596879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d28-4f38-4d6e-8030-ae75b18f2dbd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.597216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d28-4f38-4d6e-8030-ae75b18f2dbd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.600881 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 105/206] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:27.605086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.605677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.606269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.626260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:27.627763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:27.653357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:27.655095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fa0a1-061e-4bed-abb2-a061e2fb13d6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:27.686193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:27.718838 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 106/207] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:27.798465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:27.825962 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 102/208] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:27.827302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae4d6-1235-465e-9fee-bb43aefe1244 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.827599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae4d6-1235-465e-9fee-bb43aefe1244 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.827879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae4d6-1235-465e-9fee-bb43aefe1244 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.829452 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 103/209] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:27.831769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ae4d6-1235-465e-9fee-bb43aefe1244 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:27.881560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:27.918236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087b6e0-5c95-4139-bb40-f862288689fa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:27.945680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ae4d6-1235-465e-9fee-bb43aefe1244 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:27.956607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:27.957714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.958259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.958957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.970467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-836b6513-11b5-4289-838f-a51a365eb549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:27.976185 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:27.977098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:27.977912 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:27.980768 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 107/210] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:27.983066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.983323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:27.983958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:27.984333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.984435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:27.984604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.985065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:27.985773 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:27.987398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:27.994665 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 104/211] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:27 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:27.994665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.015595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:28.017190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:28.061031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.103048 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 108/212] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:28.106021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.139028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fd107-409c-4402-9fc8-3111e6241f9c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.151082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.176693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.177950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.178243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.178500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.179219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:28.179524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.181239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.190758 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 105/213] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:28.191640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.231014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b652e0-2932-413c-9f8b-01b407595b12 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.267872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.268603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.268949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.269235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.270006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398, user.id=b799db05d6fb4a05b47a316538aaa98a) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:28.270325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.272566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.286197 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 109/214] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/role_assignments?user.id=b799db05d6fb4a05b47a316538aaa98a&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=91089ca872694116b4cc806ad5ade921 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:28.287131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.302226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b57c28-a296-4791-a4d3-45cd7fb1fac4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.346274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.347457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.347696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.348827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.350351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.355983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.358284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa4a76-7f91-4cfb-9201-351c2e8e79e4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.360992 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 106/215] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:28.362815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1ba2c-9afa-45fe-af06-2e8e762e848d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.363713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1ba2c-9afa-45fe-af06-2e8e762e848d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.364297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1ba2c-9afa-45fe-af06-2e8e762e848d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.367154 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 107/216] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:28.375461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.375765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.376027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.404235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:28.405807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:28.448920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45461-9d49-4474-b64b-386fd8ac638e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.461878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.488206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.489017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.489123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.489384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] PATH_INFO: `/v3/users/5b44cba8ee2143ecb8476b7e436a360c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.498864 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 108/217] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:28.499910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.507739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] RBAC: Authorizing `identity:get_user(user_id=5b44cba8ee2143ecb8476b7e436a360c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.509223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9687-eec8-4776-b430-2a45ca128781 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.510946 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 110/218] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/users/5b44cba8ee2143ecb8476b7e436a360c => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:28.512164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c392f-08f4-4e0f-9b8b-fd0b902e6ee1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.512452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c392f-08f4-4e0f-9b8b-fd0b902e6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.512723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c392f-08f4-4e0f-9b8b-fd0b902e6ee1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.517930 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 111/219] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:28.518707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c392f-08f4-4e0f-9b8b-fd0b902e6ee1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.611555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7db5c7-d9be-449a-bda2-aa39743c30c3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.612394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.622056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c392f-08f4-4e0f-9b8b-fd0b902e6ee1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.645670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.646321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.646663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.646954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.647586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.649031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f4cc6-11e8-498c-add2-a7320ea606ec None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.655897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:28.656503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.656787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.657065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.722635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:28.724815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:28.755429 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 109/220] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:28 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:28.756866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:28.757186 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:28.757455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:28.784358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:28.785577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:28.808845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.821769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.837081 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 112/221] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:28.837081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.870393 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 110/222] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:28.871278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:28.961739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584e54-102c-431a-bf0d-186ea5db624e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:28.995792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747720f-8c0f-4016-a557-4775323d57c6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.018471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.019277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.019647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.020017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.034250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:29.040961 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:29.042069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:29.043028 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 113/223] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:29.043799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.044933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.045733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.046199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.046741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.048146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.049624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.051540 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 111/224] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:28 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:29.052171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.083969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.109160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.161253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbf9fd-22e2-4a18-9613-b302abd85c5b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.188388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23572-5673-4349-a1ef-bb75dd8ed663 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.198533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.198967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.199300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.199579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.211822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:29.216806 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:29.217710 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:29.218540 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 114/225] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:29.219176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.235584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.237127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.237629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.238354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.239465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:29.240515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.242563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.255141 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 112/226] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:29.256532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.327392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b3037-60d4-4a47-a3b3-086828aed0f4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.341980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.365222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.365962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.366247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.366523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.367256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=5b44cba8ee2143ecb8476b7e436a360c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:29.367565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.369302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.381690 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 115/227] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/role_assignments?user.id=5b44cba8ee2143ecb8476b7e436a360c&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:29.382860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.390041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa808-752e-4c63-b990-27451f15cf66 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.398194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.438607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.439143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.439424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.439695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.440382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:29.440686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.443710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.462581 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 113/228] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:29.468638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.603679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19858ac6-7666-4151-b83e-4c9079fd5a1b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.643696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.645163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.646408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.646909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.648339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.650403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.652784 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 116/229] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:29.658197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.695907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e932850-6b33-4af3-9f53-d3df865e00ac None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.712296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.774722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759a4b-95c0-4eab-852e-fe5329ae4da0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.786576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.787761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.788021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.788303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.789495 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.791198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.797868 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 114/230] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:29.811817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.819130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.820609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.825180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.825697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.827106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.830036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.832828 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 117/231] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:29.839197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.854916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.957792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32a2b-aeab-4931-b398-cde2b388dcd7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:30.023808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:30.024452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:30.024709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:30.024982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:30.026214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:30.027671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:30.029310 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 115/232] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:30.035180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:30.080671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc1a8-1bb7-4b20-940f-f8063a163ceb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:30.096370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:30.129561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:30.130930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:30.131426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:30.131887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/248726433a034042af1715625b10f7dd/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:30.135855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, user_id=248726433a034042af1715625b10f7dd, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:30.141019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd2c80-af95-4489-aa77-20c85b5fc31c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:30.185409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:30.197715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d9b0-e793-4dd4-b6f1-3111f5f3c503 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:30.236742 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 118/233] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:29 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/248726433a034042af1715625b10f7dd/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:30.240554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:30.241240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:30.241578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:30.241878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/248726433a034042af1715625b10f7dd/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:30.244296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, user_id=248726433a034042af1715625b10f7dd, role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:30.245938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676cd58-2877-4820-91f4-58ea8875d8be None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:30.328310 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:30 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/248726433a034042af1715625b10f7dd/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:31.103922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42b79-6f76-402a-a532-a2e8a23c1381 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.104452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42b79-6f76-402a-a532-a2e8a23c1381 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.104452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42b79-6f76-402a-a532-a2e8a23c1381 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.106081 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 119/235] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:31.111443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.111864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.112032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.124644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c2b2-14d5-4078-9a12-c38285a130e7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.124929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c2b2-14d5-4078-9a12-c38285a130e7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.125203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c2b2-14d5-4078-9a12-c38285a130e7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.126551 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 120/236] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:31.132195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.132480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.132813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.159820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:31.161025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:31.162935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:31.164104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:31.253372 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 117/237] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:31.284746 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 121/238] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:31.308699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:31.310886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:31.387944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:31.414611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fd6d8-fd78-4c11-b9ae-07efbc80ac26 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:31.478476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:31.479461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.481070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.481991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.506267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:31.508364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4b81-892e-404d-99cf-343c47121db5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:31.514637 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:31.515487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:31.516292 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:31.517672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:31.526400 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 118/239] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:31.532060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:31.590308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:31.590950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.591232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.591507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.593267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:31.594752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:31.601890 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 122/240] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:31.610300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:31.717144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17662eb-ac70-4bb9-8c1d-322457dc46e0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:31.738967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f740-4cae-4f44-9179-1cd6692b0e66 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:31.792638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:31.793187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.793471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.793751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.794464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:31.794776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:31.796192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:31.799943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:31.809718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:31.810408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.810649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.816446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.816446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:31.816446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6b58-14b3-42ff-af2d-0314c0509d32 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:31.819245 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 119/241] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:31.824382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:31.909853 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 123/242] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:31 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:31.911099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd623f-2812-4727-825c-d6e502c20b6c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.911489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd623f-2812-4727-825c-d6e502c20b6c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.912271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd623f-2812-4727-825c-d6e502c20b6c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.913773 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 124/243] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:31.923456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.924128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.924604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.949941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:31.951709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:31.981862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.000370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082fe-8254-4277-b753-ceda61f20a9e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.043022 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 125/244] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:32.069871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.089304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.090084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.090450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.090704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] PATH_INFO: `/v3/users/9b416ffc5f9a457c8eeefc592e05175f` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.112335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] RBAC: Authorizing `identity:get_user(user_id=9b416ffc5f9a457c8eeefc592e05175f)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.114049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.116135 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 120/245] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:31 2022] GET /identity/v3/users/9b416ffc5f9a457c8eeefc592e05175f => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.121824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.185660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.209795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590be2e3-048e-4bff-81d9-e9a4273e0208 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.235579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384774-253f-4c95-9bd1-7a356f529329 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.259726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.260380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.260662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.260933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.274753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:32.281280 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:32.282202 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:32.283004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:32.284972 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 126/246] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:32.285587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.289719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.290262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.290835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.292498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.320159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.381296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.383135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.430676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c02f-e225-44a0-8e63-7160ba7b8bf9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.453388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.479927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.480697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.481081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.481455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.482300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:32.483234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.485357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.496766 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 127/247] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.502246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.511230 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 121/248] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:32.517178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.602343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.628764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdfb9d-e9c5-49da-9c93-daffe1252af0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.634704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a50048-dfde-4148-907e-8914dd7e6a41 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.672048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.672686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.672969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.673246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] PATH_INFO: `/v3/users/5b44cba8ee2143ecb8476b7e436a360c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.673753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.674437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=5b44cba8ee2143ecb8476b7e436a360c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.674800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.675255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.675696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.675899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.677783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.678674 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 128/249] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/users/5b44cba8ee2143ecb8476b7e436a360c => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.679779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.681598 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 122/250] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.687701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.688232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.717764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.799360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70a4ba-aa38-474d-a276-128354cbcbd8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.806431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592ce4-b89f-43cd-99bd-3a1ceee43037 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.839613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.840350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.841393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.841746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.842990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.844740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5420d-38bb-4a3d-acb0-fe55b021b7fe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.847385 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 129/251] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.848191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.849013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.849648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.849913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678be78-57a1-488d-be6e-f73a98c04501 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.850270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678be78-57a1-488d-be6e-f73a98c04501 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.850511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.850607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678be78-57a1-488d-be6e-f73a98c04501 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.851812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=9b416ffc5f9a457c8eeefc592e05175f) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:32.852315 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 130/252] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:32.852641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.853247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678be78-57a1-488d-be6e-f73a98c04501 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.854639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15905f-73ba-4a29-a061-f5e41506027f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.861720 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 123/253] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/role_assignments?user.id=9b416ffc5f9a457c8eeefc592e05175f&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=91089ca872694116b4cc806ad5ade921 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:32.863152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508634-ad27-48af-ae0a-027151ceffd8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.863648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508634-ad27-48af-ae0a-027151ceffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.864141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508634-ad27-48af-ae0a-027151ceffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.883491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.884124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b1508634-ad27-48af-ae0a-027151ceffd8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:32.885306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b1508634-ad27-48af-ae0a-027151ceffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:32.964731 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 124/254] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:32.966513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb49d-8624-4184-91da-acc8c35c92ab None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.966795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb49d-8624-4184-91da-acc8c35c92ab None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.967070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cb49d-8624-4184-91da-acc8c35c92ab None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.968625 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 125/255] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:32.973738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.974863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.975300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.998395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:32.999773 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:33.014775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:33.015840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678be78-57a1-488d-be6e-f73a98c04501 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.065586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f622e-5540-499d-8867-c1c81643291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.066583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f622e-5540-499d-8867-c1c81643291b None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.067054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f622e-5540-499d-8867-c1c81643291b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.067466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f622e-5540-499d-8867-c1c81643291b None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/5b44cba8ee2143ecb8476b7e436a360c/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.069673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f622e-5540-499d-8867-c1c81643291b None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, user_id=5b44cba8ee2143ecb8476b7e436a360c, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:33.071333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f622e-5540-499d-8867-c1c81643291b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:33.085630 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 126/256] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:33.088596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.160741 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 131/257] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:32 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/5b44cba8ee2143ecb8476b7e436a360c/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:33.161877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f622e-5540-499d-8867-c1c81643291b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.294304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:33.316743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59451d44-bc47-4d4b-b006-c6d7da397de6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.353797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f622e-5540-499d-8867-c1c81643291b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.418152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.418723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.419234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.419695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.423186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.424067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.424529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.424977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.445985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:33.451539 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:33.452449 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:33.453237 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:33.455116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:33.455502 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 132/258] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:33.460864 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:33.461994 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:33.462943 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 127/259] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:33.465653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.469616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.481028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:33.589676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c960-3bad-430f-879f-795360703d34 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.629709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.630636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.631152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.631970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.632750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:33.633413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:33.635095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:33.644555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79cd3-d22c-4c56-9b48-5d453cdeec67 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.646750 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 128/260] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:33.654806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.703411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.704331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.704886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.706070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.707736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:33.708397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:33.711837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:33.715213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:33.727589 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 133/261] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:33.733226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.773379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:33.832935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765477-229a-41da-b6e2-9035aacbb64c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.893939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.895801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.896565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.897730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.899810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:33.902602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:33.905193 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 129/262] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:33.910734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:33.912032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c747df9-d25f-4c92-8352-a89d55ea79a4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:33.991663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:33.992508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:33.992988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:33.993404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] PATH_INFO: `/v3/users/248726433a034042af1715625b10f7dd` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:33.994708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] RBAC: Authorizing `identity:get_user(user_id=248726433a034042af1715625b10f7dd)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.001853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:34.004065 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 134/263] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/users/248726433a034042af1715625b10f7dd => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:34.009919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.141649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cf1d-3b8d-4d3a-b612-80473fd094d0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.150828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.200496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:34.201113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.201399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.201675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.210884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.237884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94c4-c1d1-4a7f-9e8e-a96b218b41b4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.301272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:34.303383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.303844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.304293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.346762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.348273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:34.424098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.425616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:34.526296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.559288 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 130/264] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:34.566012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.593056 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 135/265] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:34.598632 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.624398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.737922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925dc9-12bc-446f-bea4-b69cb9c32b16 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.775332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f02f-647a-4bcb-89b5-927a6b790b33 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.790659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:34.791225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.791514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.791789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.792933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.797868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:34.801267 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 131/266] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:34.802846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.885671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:34.886746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.887209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.887658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.894611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.896792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:34.899047 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 136/267] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:34.905565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.973871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5d7d-f831-4c4b-9b5d-7c97dbab42b8 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.986200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:35.013204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:35.036211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:35.036834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.037120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.037433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.038220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=248726433a034042af1715625b10f7dd) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:35.038541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:35.039988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2069-bb39-4429-a6be-a30015dc5714 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:35.046762 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 132/268] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/role_assignments?user.id=248726433a034042af1715625b10f7dd&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:35.142908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda9815-5bd0-4f65-b607-af80e92eb829 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:35.204127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:35.205139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.205651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.206151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.207177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=248726433a034042af1715625b10f7dd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:35.207494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:35.209412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57822a21-d17f-405b-a1c5-09ba0428bd8a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:35.223179 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 137/269] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/role_assignments?user.id=248726433a034042af1715625b10f7dd&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:35.525427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3f69-c9bd-4724-b624-27d4f9ea1407 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.526117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3f69-c9bd-4724-b624-27d4f9ea1407 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.526117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3f69-c9bd-4724-b624-27d4f9ea1407 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.527861 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 133/270] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:35.534456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdd93-eb91-4a14-8101-0ac6f552f61d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.535321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdd93-eb91-4a14-8101-0ac6f552f61d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.535321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdd93-eb91-4a14-8101-0ac6f552f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.556863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d98cdd93-eb91-4a14-8101-0ac6f552f61d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:35.558139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d98cdd93-eb91-4a14-8101-0ac6f552f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:35.639619 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 138/271] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:35.662718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3f69-c9bd-4724-b624-27d4f9ea1407 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:35.764447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ae0c-39bf-4b83-9425-3c8254a30dc2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.764807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ae0c-39bf-4b83-9425-3c8254a30dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.764982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ae0c-39bf-4b83-9425-3c8254a30dc2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.766668 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 139/272] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:35.780964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.781294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.781680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.787949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3f69-c9bd-4724-b624-27d4f9ea1407 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:35.807941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:35.809745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:35.835497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:35.836434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:35.836886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:35.837314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:35.838414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:35.852462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:35.863599 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:35.865095 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:35.865928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:35.867019 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 134/273] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:35.874761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:35.914263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:35.921926 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 140/274] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:35.939571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.007216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0fc61-c471-4a1a-ab9e-e1d94f19c2ae None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.044222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.044748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.045026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.045301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.046000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:36.046306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.047685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96ed7-7bf8-419a-9061-3aaa0a0a5142 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.056217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b29e-1c0b-4f3b-bea4-9a1090d75f6b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.056843 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 135/275] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:36.057928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519f6e-8038-47fe-88d0-8a625f82d374 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.058214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519f6e-8038-47fe-88d0-8a625f82d374 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.058484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519f6e-8038-47fe-88d0-8a625f82d374 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.064110 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 136/276] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:36.064632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e519f6e-8038-47fe-88d0-8a625f82d374 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.097789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.098456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.099335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.099630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.100745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.102254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94acf1f-5aaf-4674-b223-d8a09a44d939 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.103883 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 141/277] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:36.109561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.109871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.110166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.128398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:36.129583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:36.146873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.163151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.173865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e519f6e-8038-47fe-88d0-8a625f82d374 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.197213 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 142/278] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:36.198207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.208842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.209500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.209785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.210100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] PATH_INFO: `/v3/users/2a49c2778f484a4aa830c0d9d24f2cae` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.223297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a49c2778f484a4aa830c0d9d24f2cae)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.225351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ea494-1617-47dd-9b7d-b0efd7f45df1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.227019 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 137/279] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/users/2a49c2778f484a4aa830c0d9d24f2cae => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:36.228200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ecdd-9f5e-4709-b00d-07778d1cf938 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.228481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ecdd-9f5e-4709-b00d-07778d1cf938 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.228769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ecdd-9f5e-4709-b00d-07778d1cf938 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.229967 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 138/280] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:36.230652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7ecdd-9f5e-4709-b00d-07778d1cf938 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.310196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765309f4-ca07-4cdd-b803-db057fcc9111 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.328850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7ecdd-9f5e-4709-b00d-07778d1cf938 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.343888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.344490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.345042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.345743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.347155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053750b-228a-443e-be33-fc603a6f40f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.363414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.364037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.364454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.364924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.375096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:36.379906 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:36.380979 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:36.381990 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 139/281] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:36.382887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.392494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.429646 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 143/282] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:58:36 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:36.432083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.432558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.432992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.473012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:36.475678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:36.480990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.491905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a03ac-3e04-48b3-b980-978d95ac167a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.532488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.533199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.533367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.533640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.534402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, user.id=2a49c2778f484a4aa830c0d9d24f2cae, scope.system=all) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:36.534714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.536957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.542815 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 140/283] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/role_assignments?user.id=2a49c2778f484a4aa830c0d9d24f2cae&scope.system=all&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:36.543663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.575518 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 144/284] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:36.604740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.635040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.691358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325767-270e-41ef-bee1-29caa910cfe3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.741490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.742254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.742871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.743209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.743968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:36.744348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.745257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8588d-6c52-4abf-a722-83e79ba26f5a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.745794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.758419 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 141/285] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:36.763792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.795611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.796255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.796538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.796813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.807180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.811336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:36.816685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:36.818153 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:36.819076 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 145/286] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:36.827934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.894883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159a6-53a9-409c-bdc9-b6b1322fd86e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:36.940098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:36.941069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:36.941577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:36.942105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] PATH_INFO: `/v3/users/9b416ffc5f9a457c8eeefc592e05175f` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:36.943856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] RBAC: Authorizing `identity:get_user(user_id=9b416ffc5f9a457c8eeefc592e05175f)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:36.945542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:36.947851 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 142/287] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/users/9b416ffc5f9a457c8eeefc592e05175f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:36.956530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:36.960611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:36.969272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ca04-98b9-4af6-bcc1-28cebb15e106 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.011593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.012346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.012702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.013086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.013841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:37.014221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.019111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.043404 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 146/288] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:37.050844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.120100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.139372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecf873-c96a-4de6-b102-34450eeeec41 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.162889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e5c2d-758d-4e45-8253-0a25d081aa12 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.176201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.177286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.177770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.178288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.179628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.181283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.183528 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 143/289] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:36 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:37.192875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.212855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.212855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.212855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.212855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] PATH_INFO: `/v3/users/5b44cba8ee2143ecb8476b7e436a360c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.213361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] RBAC: Authorizing `identity:get_user(user_id=5b44cba8ee2143ecb8476b7e436a360c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.213361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.213361 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 147/290] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:37 2022] GET /identity/v3/users/5b44cba8ee2143ecb8476b7e436a360c => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:37.218117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.364331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34e56-7a01-4bad-b6cf-c72eefebd0ad None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.395497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.402567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.410682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.411916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.412196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.412757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.463699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59575a-009a-4b86-9e10-a50e9498a203 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.517548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.519164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.559471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.560151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.560424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.560705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/9b416ffc5f9a457c8eeefc592e05175f/roles/91089ca872694116b4cc806ad5ade921` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.567126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, user_id=9b416ffc5f9a457c8eeefc592e05175f, role_id=91089ca872694116b4cc806ad5ade921)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.569120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.626240 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 148/291] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:37.631900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.657892 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 144/292] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:58:37 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/users/9b416ffc5f9a457c8eeefc592e05175f/roles/91089ca872694116b4cc806ad5ade921 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:58:37.668542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.756919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ea175-44e3-4bb7-b1b2-249239a573de None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.796269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.796955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.797237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.797573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.798771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.800226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647fb3-3795-44d8-b6bb-ae5ecac38f4a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.802516 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 149/293] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:37 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:37.808512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.923355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b93d4-1750-4e44-9688-67a0eba421ea None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.955777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.964144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.964747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.965032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.965305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.966062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=5b44cba8ee2143ecb8476b7e436a360c) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:37.968958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.968958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708031fd-1278-4832-a16f-0b2ee46cd9c1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.975658 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 145/294] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:37 2022] GET /identity/v3/role_assignments?user.id=5b44cba8ee2143ecb8476b7e436a360c&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:38.860211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567b72f-61f7-4075-85b8-785fb077ab61 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:38.860755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567b72f-61f7-4075-85b8-785fb077ab61 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:38.860755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567b72f-61f7-4075-85b8-785fb077ab61 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:38.862369 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 150/295] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:38.868004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71a79-359d-4718-a60b-efd08d4ad3f6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:38.868420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71a79-359d-4718-a60b-efd08d4ad3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:38.868628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71a79-359d-4718-a60b-efd08d4ad3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:38.887471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-faf71a79-359d-4718-a60b-efd08d4ad3f6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:38.888657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-faf71a79-359d-4718-a60b-efd08d4ad3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:38.960122 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 146/296] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:38.975348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211214a4-1b79-4763-b330-087bf312341c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:38.975670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211214a4-1b79-4763-b330-087bf312341c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:38.976115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211214a4-1b79-4763-b330-087bf312341c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:38.977917 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 151/297] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:38.982441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211214a4-1b79-4763-b330-087bf312341c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:38.982954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897238c-e366-4138-8a12-52a6fb5a4acb None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:38.983248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897238c-e366-4138-8a12-52a6fb5a4acb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:38.983529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897238c-e366-4138-8a12-52a6fb5a4acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.003111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a897238c-e366-4138-8a12-52a6fb5a4acb None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:39.004300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a897238c-e366-4138-8a12-52a6fb5a4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:39.112929 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 147/298] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:39.115903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5866-2b78-4136-b02a-0d7acada3415 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.116186 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5866-2b78-4136-b02a-0d7acada3415 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.116459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b5866-2b78-4136-b02a-0d7acada3415 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.117909 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 148/299] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:39.122842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.123134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.123418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.141018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:39.142239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:39.157423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.162757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211214a4-1b79-4763-b330-087bf312341c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.194885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.196596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.197230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.197511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.197890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.208486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:39.212842 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 149/300] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:39.213670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:39.222715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:39.224059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:39.224938 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:39.227814 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 152/301] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:39.235323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.324399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5268d-d5a0-469b-a534-8ceb8da39a43 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.338170 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b59c3f-f6a1-4465-abd9-5f1b7cadaeca None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.362643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.363298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.363525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.363800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.373143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.373743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.374051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.374322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.374980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:39.375272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:39.375367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.376730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:39.380546 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:39.381385 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:39.382203 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 150/302] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:39.383319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.395557 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 153/303] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:39.395557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.415898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.439114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.494065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007c61c-d194-4c9a-8d4c-3eec558701e5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.507499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd429b8-60be-4071-80dd-77f68327038e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.529729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.530440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.530657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.530931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.532064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.533506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.540128 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 151/304] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:39.540128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.549089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.549777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.550158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.550509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.551248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:39.552188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.553660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.566755 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 154/305] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:39.566755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.650849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.651018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae84f8-08fb-40e3-ae27-0cc15883e397 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.665705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.669334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e593df-22de-4fde-b687-ec379ffa48dc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.690509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.691145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.691426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.691705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] PATH_INFO: `/v3/users/2a49c2778f484a4aa830c0d9d24f2cae` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.692963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] RBAC: Authorizing `identity:get_user(user_id=2a49c2778f484a4aa830c0d9d24f2cae)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.694442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.696049 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 152/306] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/users/2a49c2778f484a4aa830c0d9d24f2cae => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:39.696857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.711921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.712541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.712854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.713202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] PATH_INFO: `/v3/groups` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.714222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.715419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.795257 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 155/307] 10.222.0.36 () {60 vars in 1134 bytes} [Sun Aug 7 00:58:39 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:58:39.795257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.801229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8067-11d0-412f-ad68-92796f6493ec None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.840707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.841458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.841735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.842051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] PATH_INFO: `/v3/users/974622e9ba234703af62bba0db8d93c1` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.857921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] RBAC: Authorizing `identity:get_user(user_id=974622e9ba234703af62bba0db8d93c1)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.859424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.861524 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 153/308] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/users/974622e9ba234703af62bba0db8d93c1 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:39.869989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:39.916219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:39.944510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11669c9-f306-44a1-8579-852852d2ac64 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:39.983735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:39.984931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.984931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.984931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] PATH_INFO: `/v3/system/users/2a49c2778f484a4aa830c0d9d24f2cae/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.986647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a49c2778f484a4aa830c0d9d24f2cae, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:39.988155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:39.992982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46476d-eeeb-4aa9-a904-f79dfa93c16e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.028207 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.028815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.029092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.029354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.030108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, user.id=974622e9ba234703af62bba0db8d93c1, scope.system=all) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:40.030416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:40.031829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf67a7-4d66-485f-8b62-624b86f1602e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:40.037389 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 154/309] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Aug 7 00:58:39 2022] GET /identity/v3/role_assignments?user.id=974622e9ba234703af62bba0db8d93c1&scope.system=all&role.id=91089ca872694116b4cc806ad5ade921 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:40.038559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d20b3-b287-4447-8e15-b90065175280 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.038894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d20b3-b287-4447-8e15-b90065175280 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.039167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d20b3-b287-4447-8e15-b90065175280 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.041874 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 155/310] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:40.047667 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 156/311] 10.222.0.36 () {58 vars in 1334 bytes} [Sun Aug 7 00:58:39 2022] PUT /identity/v3/system/users/2a49c2778f484a4aa830c0d9d24f2cae/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:40.051583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.051583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.051583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.070136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:40.071570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:40.155314 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:40.178774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:40.189664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.290830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a708b8c-e7bc-4992-8675-797c7dbc9c8d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.325722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.326381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.326659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.326932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.337815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:40.343046 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:40.343915 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:40.344685 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:40.353710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:40.383630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.457370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3f93-ba97-4dac-ad75-736a8fdaa2b9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.492842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.493794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.494329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.494794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.495642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:40.496136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:40.497691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:40.507379 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:40.513259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:40.592102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.631725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5a68-681b-4b99-98bd-d2442102026f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.666655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.667283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.667564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.667840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] PATH_INFO: `/v3/users/9b416ffc5f9a457c8eeefc592e05175f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.668960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] RBAC: Authorizing `identity:get_user(user_id=9b416ffc5f9a457c8eeefc592e05175f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:40.670425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:40.672302 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:40 2022] GET /identity/v3/users/9b416ffc5f9a457c8eeefc592e05175f => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:40.678394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:40.778571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.785071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa016-fadc-4903-8da7-c5326a3d8200 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.820004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.820616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.820903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.821177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.891754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:40.893233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:41.002235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:41.011073 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:41.016882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:41.127448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4714aa-b5a1-4780-9abe-2a947e121d5b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:41.162365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:41.162996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:41.163280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:41.163558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:41.164691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:41.166214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed0f37-471f-4458-8d91-db469b9e8580 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:41.168252 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 159/317] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:41 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:41.173931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:41.285390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798b73-adf7-443c-b402-ed474d574181 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:41.322948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:41.323893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:41.324386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:41.324876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:41.325789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, scope.project.id=c0fc837d07c049d8a01cb68346867bce, user.id=9b416ffc5f9a457c8eeefc592e05175f) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:41.326369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:41.328000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d66e3-5e33-45f2-8a81-211c7a016fe8 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:41.335219 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:58:41 2022] GET /identity/v3/role_assignments?user.id=9b416ffc5f9a457c8eeefc592e05175f&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=91089ca872694116b4cc806ad5ade921 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:41.915934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb924a2-bf7c-442e-91f8-7993dc83c109 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:41.916303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb924a2-bf7c-442e-91f8-7993dc83c109 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:41.916489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb924a2-bf7c-442e-91f8-7993dc83c109 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:41.917991 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 160/319] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:41.922885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff4c4-91ea-4c8e-80fd-0e915d7f9316 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:41.923338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff4c4-91ea-4c8e-80fd-0e915d7f9316 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:41.923502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff4c4-91ea-4c8e-80fd-0e915d7f9316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:41.941654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2e9ff4c4-91ea-4c8e-80fd-0e915d7f9316 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:41.943388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2e9ff4c4-91ea-4c8e-80fd-0e915d7f9316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:42.006305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.020841 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 160/320] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:42.042723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb924a2-bf7c-442e-91f8-7993dc83c109 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.045727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.146171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb924a2-bf7c-442e-91f8-7993dc83c109 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.166188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb722-ca0e-4b93-b777-138c3b6da814 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.166435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb722-ca0e-4b93-b777-138c3b6da814 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.166683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb722-ca0e-4b93-b777-138c3b6da814 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.168278 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 161/321] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:42.173012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105185-d4b5-4d1e-8844-2bb888032c2a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.173299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105185-d4b5-4d1e-8844-2bb888032c2a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.173577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105185-d4b5-4d1e-8844-2bb888032c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.179649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.180435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.180719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.181820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.182952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.184395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.192440 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 161/322] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:42.192634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6d105185-d4b5-4d1e-8844-2bb888032c2a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:42.193244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.193702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6d105185-d4b5-4d1e-8844-2bb888032c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:42.262461 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 162/323] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:42.263535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3027-24f2-4fc2-8142-7e1a9a8df594 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.263819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3027-24f2-4fc2-8142-7e1a9a8df594 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.264087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3027-24f2-4fc2-8142-7e1a9a8df594 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.265453 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 163/324] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:42.269606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.272072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.272353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.272624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.290200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:42.291371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:42.300847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2a07-c838-4d1f-be79-d64ab7e3aac4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.335431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.336029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.336309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.336584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] PATH_INFO: `/v3/groups` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.337214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.338693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.358186 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 164/325] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:42.362130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.406740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.426440 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 162/326] 10.222.0.36 () {60 vars in 1134 bytes} [Sun Aug 7 00:58:42 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:58:42.427185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.470388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f577-751a-4e60-a91b-8542c0f9e554 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.511055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.511706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.511993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.512270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.525461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:42.530445 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:42.531343 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:42.532167 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 165/327] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:42.538426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.550575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be773d-10f2-43ae-b655-a2ba47ae5975 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.582458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.588488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.588765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.589046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.589319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.600934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:42.605760 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:42.606648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:42.607621 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 163/328] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:42.612783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.650393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4c65b-139a-43ca-8265-13eb0199e87b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.660180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.692150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.692698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.692978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.693250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.693948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:42.694256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.695761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.705379 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 166/329] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:42.711245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.733491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f657e-a10c-481b-abf9-4f9fa371b0cb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.774837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.775550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.775955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.776398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.777091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:42.777593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.778958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.788602 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 164/330] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:42.794985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.834336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e092-f044-4f31-b0d4-5111a59c84f0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.869615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.882857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.883817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.884317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.884727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] PATH_INFO: `/v3/users/974622e9ba234703af62bba0db8d93c1` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.886333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] RBAC: Authorizing `identity:get_user(user_id=974622e9ba234703af62bba0db8d93c1)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.888496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.891100 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 167/331] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/users/974622e9ba234703af62bba0db8d93c1 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:42.898320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:42.928967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996b0d2-4b09-4bf1-b674-9ab4c01b6794 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:42.953093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:42.975983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:42.975983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.975983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.975983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] PATH_INFO: `/v3/users/2a49c2778f484a4aa830c0d9d24f2cae` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.979465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] RBAC: Authorizing `identity:get_user(user_id=2a49c2778f484a4aa830c0d9d24f2cae)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:42.979465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:42.983643 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 165/332] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/users/2a49c2778f484a4aa830c0d9d24f2cae => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:42.989695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:43.051985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1af8c0-1b78-46b9-b8e3-03399e761bec None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:43.098369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:43.099400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:43.099691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:43.099974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] PATH_INFO: `/v3/system/users/974622e9ba234703af62bba0db8d93c1/roles/91089ca872694116b4cc806ad5ade921` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:43.101458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=974622e9ba234703af62bba0db8d93c1, role_id=91089ca872694116b4cc806ad5ade921)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:43.102966 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe6bc9-d66f-40e1-a6de-2b9e05f0d1fe None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:43.137171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac8e0f-5e34-4467-8ff0-2fe04f010762 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:43.160006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:43.178977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:43.179594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:43.179875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:43.180149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:43.180519 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 168/333] 10.222.0.36 () {58 vars in 1334 bytes} [Sun Aug 7 00:58:42 2022] PUT /identity/v3/system/users/974622e9ba234703af62bba0db8d93c1/roles/91089ca872694116b4cc806ad5ade921 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:58:43.180881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] RBAC: Adding query filter params (role.id=f097b8e696684df78b8f3a53be01a5d9, user.id=2a49c2778f484a4aa830c0d9d24f2cae, scope.system=all) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:43.181191 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:43.182748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804160-48d6-4db7-ba59-1e666f16235c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:43.198079 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 166/334] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Aug 7 00:58:42 2022] GET /identity/v3/role_assignments?user.id=2a49c2778f484a4aa830c0d9d24f2cae&scope.system=all&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:44.760494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b07f-217a-4a44-8d7d-1c88a59868a9 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:44.761379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b07f-217a-4a44-8d7d-1c88a59868a9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:44.761805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5b07f-217a-4a44-8d7d-1c88a59868a9 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:44.763578 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 169/335] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:44.769429 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:44.770446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:44.770933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:44.791198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:44.792756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:44.879195 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 167/336] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:44.904794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5b07f-217a-4a44-8d7d-1c88a59868a9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.033697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5b07f-217a-4a44-8d7d-1c88a59868a9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:45.035250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:45.076882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:45.077519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.077884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.078119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.091454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-dae1dade-bbc7-40ab-95d2-2431bd170154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:45.096180 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:45.097125 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:45.098455 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 170/337] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:45.104398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.106854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742222-5591-4a2b-abd6-7ac4797aa8c3 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.107140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742222-5591-4a2b-abd6-7ac4797aa8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.107418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742222-5591-4a2b-abd6-7ac4797aa8c3 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.108948 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 171/338] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:45.116054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.116339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.116615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.139795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:45.140994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:45.236248 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 172/339] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:45.270735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.285169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa2df-42da-4aab-a723-51edc0f44eb8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:45.304267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:45.353432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:45.354073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.354358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.354634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.355619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:45.355989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:45.357758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:45.375365 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 168/340] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:45.382410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.438205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:45.455651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85f5d-52c6-42df-803c-04bdf075c89a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:45.521358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:45.522024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.522935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.523262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.539013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:45.544749 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:45.545610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:45.546432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:45.547034 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 173/341] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:45.554165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.567816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c93b2-8445-4fdc-82c1-7768be167b08 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:45.645939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:45.646830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.647237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.647516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.720487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:45.776100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:45.777750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:45.805776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704691-4a04-4d39-9690-569cb6548423 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:45.905320 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 169/342] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:45.911943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.915298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:45.915935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:45.916220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:45.916500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:45.917185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:45.917493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:45.918926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:45.936916 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 174/343] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:45.946840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:45.989863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:45.994212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.020304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d9f8-4360-438d-9694-07fb8be998bf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.057887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.058530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.058806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.059084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.060292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:46.065478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:46.065478 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 170/344] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:46.070305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.189860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704b2-61dd-4259-bf27-cb1f97951a18 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.228571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.229212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.229494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.229771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.231799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25435e6d-160e-40a5-94d0-4625ac17dda5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.237272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:46.238854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:46.241092 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 171/345] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:46.247283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.261345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.303132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.303758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.304044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.304322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.371799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339170e5-3e9b-403f-9b5f-bae8a1952f61 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.383982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:46.385492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9fed-79a5-4aa5-a78f-16d45c43f344 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:46.411602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.428277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.429156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.429437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.429713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.430668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:46.431292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:46.433094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26ccb-90f3-4958-b828-9616159c3f71 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:46.440135 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 172/346] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:46.442367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeca02-986f-44b1-a76e-24af681d0007 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.442650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeca02-986f-44b1-a76e-24af681d0007 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.442921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeca02-986f-44b1-a76e-24af681d0007 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.445960 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 173/347] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:46.447098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157482bf-ff59-4cde-9412-e0c0feb20f47 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.447382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157482bf-ff59-4cde-9412-e0c0feb20f47 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.447717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157482bf-ff59-4cde-9412-e0c0feb20f47 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.449016 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 174/348] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:46.455672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.455959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.456239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.496963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:46.498223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:46.575360 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:46.576463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.576750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.577106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.622275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:46.623489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:46.641980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.649951 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 175/350] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:46.652340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.729012 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 176/351] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:46.729903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.777655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7edc0-5b5d-4e34-b01c-124683cdca0a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.796060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.815820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.816508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.817403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.817672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.820283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:46.821852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:46.824021 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 176/352] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:46.824805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.862913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50278e6-6ec4-4a7d-80ba-30768b0f8584 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.898330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:46.906351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.906989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.907266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.907536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.920123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:46.924948 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:46.925914 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 177/353] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:46.927858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:46.934386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c114c-0f57-49e4-ac38-a082108cabc5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:46.973062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:46.973705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:46.974037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:46.974311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:46.990226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:46.992881 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:46.994548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:58:46.995535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:46.996591 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 177/354] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:46.998418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.049398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdc4b4-52c9-4ba1-856a-bac336c7ca4b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.052590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.089823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.090613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.090955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.091296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.092506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.094099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.096044 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.096931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.121582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2afcc-effd-4e9d-ae62-205ca80c7352 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.147352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.167812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.167812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.167812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.167812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.168189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:47.168189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.168189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.179812 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.180562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.209075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6c7f-1462-41dd-b130-f43b1cc08a3d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.246190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.246803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.247082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.247355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.248020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:47.248337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.253856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.263465 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 179/357] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.265246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.322681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.374795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6e353-cb9f-4055-ae62-4c7b209ded10 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.408744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2955-5cb9-42a7-9163-d5bf451b6b7c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.421982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.422473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.422754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.423027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.423750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:47.424058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.425471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658815a-8589-41ce-bd96-d7d2d66328ac None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.435598 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 179/358] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.436670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e4a-bbcb-4b4d-a943-14e6e5ea691d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.436954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e4a-bbcb-4b4d-a943-14e6e5ea691d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.437227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e4a-bbcb-4b4d-a943-14e6e5ea691d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.438760 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 180/359] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:47.439466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17e4a-bbcb-4b4d-a943-14e6e5ea691d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.468211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.469243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.469723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.471729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.508537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.556819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.558747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.565646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17e4a-bbcb-4b4d-a943-14e6e5ea691d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.599556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.610958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.611536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.611814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.612086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] PATH_INFO: `/v3/users/974622e9ba234703af62bba0db8d93c1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.619557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] RBAC: Authorizing `identity:get_user(user_id=974622e9ba234703af62bba0db8d93c1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.619557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dffd8-ebe2-4843-8602-0611fc17fe99 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.619557 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 181/360] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/users/974622e9ba234703af62bba0db8d93c1 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.624208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9aa-ae14-447e-82bf-6ff5d7607884 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.624465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9aa-ae14-447e-82bf-6ff5d7607884 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.624743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9aa-ae14-447e-82bf-6ff5d7607884 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.626316 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 182/361] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:47.627418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04fb2-87b6-4d4b-81fc-de36b30b9924 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.627645 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04fb2-87b6-4d4b-81fc-de36b30b9924 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.631021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04fb2-87b6-4d4b-81fc-de36b30b9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.652822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-73d04fb2-87b6-4d4b-81fc-de36b30b9924 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:47.653975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73d04fb2-87b6-4d4b-81fc-de36b30b9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:47.676771 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 180/362] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:47.677934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.739145 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 183/363] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:47.741128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.741128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.741425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.774967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:47.777102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:47.819899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ecc6-f72c-4249-9e85-b13e732fe1db None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:47.844397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.868741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:47.869253 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 184/364] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:47.869653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.869942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.870065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.870234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.870979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] RBAC: Adding query filter params (role.id=91089ca872694116b4cc806ad5ade921, user.id=974622e9ba234703af62bba0db8d93c1, scope.system=all) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:47.871295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:47.872921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:47.879771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.897390 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 181/365] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/role_assignments?user.id=974622e9ba234703af62bba0db8d93c1&scope.system=all&role.id=91089ca872694116b4cc806ad5ade921 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:47.898181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.048298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40d8b-71cf-4430-82c9-7125ec5738be None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.066661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd12a-79d7-45de-9914-9a9d96411c66 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.089313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.090449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.090944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.091496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.093344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.095147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.102300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 185/366] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:48.103556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.116965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.117612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.117926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.118206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.133381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:48.138717 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:48.139628 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:48.140439 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:48.146405 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 182/367] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:48.147332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.175702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.256056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d644-234c-49a4-bc4b-d58a110527dd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.282260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.297213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.298605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.298900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.299187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.315423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e2d51-6147-4bba-a534-43de8e813fdb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.336652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:48.343851 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:48.344769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:48.345550 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:48.351090 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 186/368] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:48.352799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.375445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.378263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.378547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.378818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.381735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.383211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.386054 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 183/369] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:48.386740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.522992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8299b6-011f-4336-ad2b-9ec0516dc58a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.532157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.539375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a982f-6f7a-435e-b1b6-9b354cdd4516 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.562318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.563392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.563502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.563700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.564870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:48.565386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.567427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.568543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.577294 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 187/370] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:48.578267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.590111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350354-c269-412c-a381-625991e8889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.590984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350354-c269-412c-a381-625991e8889f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.591413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350354-c269-412c-a381-625991e8889f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.591836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350354-c269-412c-a381-625991e8889f None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.593415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350354-c269-412c-a381-625991e8889f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:48.593892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350354-c269-412c-a381-625991e8889f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.595919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350354-c269-412c-a381-625991e8889f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.608194 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 184/371] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:48.609210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350354-c269-412c-a381-625991e8889f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.726670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2ebf-091e-4e50-91e0-84004f2f51f8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.740129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350354-c269-412c-a381-625991e8889f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.771499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.772534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.772964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.773464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.775019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=c0fc837d07c049d8a01cb68346867bce) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:48.775487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.777226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.784974 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 188/372] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:48.789925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:48.790089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.790089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.790089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.790089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.850217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.911181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.944928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d3902-b599-4a65-89ec-77e5c3922733 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.951670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.953210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200026-2cce-4fd5-9e8e-5df2285357d6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.009035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.010041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.010490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.011697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.117273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.118813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079075f0-41fc-44c2-ad06-27263bc5b7ff None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.157036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.158311 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 185/373] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:49.159625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132c75-008e-433c-8ebf-666164f141d3 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.159915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132c75-008e-433c-8ebf-666164f141d3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.160236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132c75-008e-433c-8ebf-666164f141d3 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.161622 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 186/374] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:49.165530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86132c75-008e-433c-8ebf-666164f141d3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.234940 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 189/375] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:49.236493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.236791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.237067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.256894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:49.257606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.258876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:49.279138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86132c75-008e-433c-8ebf-666164f141d3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.325146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.326167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.326656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.327432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] PATH_INFO: `/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.329084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] RBAC: Authorizing `identity:get_project(project_id=4d8f722b65514efcbdc7ef3dc7a594c9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.331366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.334917 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 187/376] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.336039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.361294 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 190/377] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:49.362027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.432163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.482834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2e2a5-776a-4148-a94b-7ce37d9885fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.495103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f64b69-ca22-4b3d-bc3c-f5dcb4c6f668 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.530922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.531565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.531852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.532125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] PATH_INFO: `/v3/groups/3423e2cf308244118f52c7ef99d31eb4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.534892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.536235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.536697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.537281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.537669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] RBAC: Authorizing `identity:get_group(group_id=3423e2cf308244118f52c7ef99d31eb4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.538827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.539226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.542818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.542969 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 191/378] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/groups/3423e2cf308244118f52c7ef99d31eb4 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.542969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.545333 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 188/379] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.550709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.574720 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.657159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e152af-21b6-4259-81c4-9b6e9ccfde9e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.667818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe9070-791e-4a58-8996-8b256e6fc9ac None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.684977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.694303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.701657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.701657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.701657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.713347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:49.717680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:49.718218 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:49.719137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:49.720407 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 192/380] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:49.721139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.723375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.723891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.724362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.725304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] RBAC: Adding query filter params (group.id=3423e2cf308244118f52c7ef99d31eb4, role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=4d8f722b65514efcbdc7ef3dc7a594c9) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:49.725824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.727978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.736597 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 189/381] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/role_assignments?group.id=3423e2cf308244118f52c7ef99d31eb4&scope.project.id=4d8f722b65514efcbdc7ef3dc7a594c9&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.738433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.855336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:49.859276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac322f3-3390-47b2-beb3-0d7fda460878 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.880459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a35e4-7f29-480a-82b8-acbacd9cbc68 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:49.913761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.914737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.915163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.915594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.917266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.920261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db1dce-4a1c-4034-a921-2bf596b560e8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.922735 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 193/382] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.924160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae4aa-9252-4d05-92a0-dd17d2cc9a0b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.924570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae4aa-9252-4d05-92a0-dd17d2cc9a0b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.924989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfae4aa-9252-4d05-92a0-dd17d2cc9a0b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.926955 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 194/383] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:49.932310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfae4aa-9252-4d05-92a0-dd17d2cc9a0b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:49.940960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:49.941810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.942262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.942751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.943553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:49.943984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:49.945510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8c88c-7728-47c0-860c-d79d3c3ee7e8 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:49.959035 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 190/384] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:49.960765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:49.961002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:49.961384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:49.987718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:49.990192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:50.021684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.075512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfae4aa-9252-4d05-92a0-dd17d2cc9a0b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.081037 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 191/385] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:50.082989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.125140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.126311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.127611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.128099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.129627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=c0fc837d07c049d8a01cb68346867bce) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:50.130182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.131854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.140161 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 195/386] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:49 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.141239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.260811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.280444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370da97-56b6-4f13-91f4-cc9a95024199 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.303567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.323326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.324553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.325057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.325560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.341644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:50.347366 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:50.348889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:50.349675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:50.351878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b511c1-3a2a-4a5d-a5d3-5886eec14175 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.352654 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 196/387] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:50.359190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.417032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.417722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.418028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.418309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.420767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.422068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.424118 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 192/388] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.429973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.476710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f534-f2c5-4c83-ac45-6ecef6ebed91 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.543118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.544885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.546077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.546739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.548549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:50.549282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.552344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.572328 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 197/389] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.575595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.639085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d6d9-04bc-4e21-92aa-34d0707dfc60 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.650197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.675660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.676806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.677106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.680679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.681555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.683213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.686396 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 193/390] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.691234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.705778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.737083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3e131-258c-4dd4-a3b7-db2c42b82a1f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.783333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.783974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.784253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.784528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.786388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.789544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.790096 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 198/391] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.795287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.820530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566fe6-2bea-419b-8f22-68955905462e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.862943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.864376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.864858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.865303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/groups/0ab055b20ff244a589fe979281b33cef/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.867766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, group_id=0ab055b20ff244a589fe979281b33cef, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.869370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ec398-d12e-4430-99ce-bff274acf746 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.907827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b087d6-606b-4b47-8a47-0769254ea1e6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:50.917806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:50.943516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:50.944156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.944436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.944755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.946001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:50.947540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:50.951722 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 199/392] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:50 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:50.955656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:50.990034 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 194/393] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Aug 7 00:58:50 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/groups/0ab055b20ff244a589fe979281b33cef/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:58:51.070734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b46bce-253a-4db5-bcfc-54f9adcc67e3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:51.107657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:51.108323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:51.108603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:51.108879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/groups/0ab055b20ff244a589fe979281b33cef/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.111141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e7cd04e9d74a3db9f85eeea68ad398, group_id=0ab055b20ff244a589fe979281b33cef, role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:51.112606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825c550-f3aa-4dec-91cd-067ffe737cb8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:51.185126 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 200/394] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Aug 7 00:58:50 2022] PUT /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398/groups/0ab055b20ff244a589fe979281b33cef/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:58:51.464373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa12a-76a4-46a4-97ce-f0d08e973f9e None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:51.465057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa12a-76a4-46a4-97ce-f0d08e973f9e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:51.465559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa12a-76a4-46a4-97ce-f0d08e973f9e None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.467487 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 195/395] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:51.472494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:51.474066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:51.474765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.496320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:51.497862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:51.539627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:51.587203 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 201/396] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:51.625550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fa12a-76a4-46a4-97ce-f0d08e973f9e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:51.724765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:51.753325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fa12a-76a4-46a4-97ce-f0d08e973f9e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:51.793173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:51.793805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:51.794117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:51.794394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.806137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:51.811814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:51.812803 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:51.813613 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 196/397] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:51.821166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:51.960449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4fe8-933d-40cc-8a35-afcc4ba9dae2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.011948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.012566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.012845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.013118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.013782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:52.014232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:52.015625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:52.029950 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 202/398] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:52.035990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.164484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639288-8533-48c9-bb1d-78d78457dc1c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.196605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:52.202521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.203208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.203493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.203772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.204940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:52.206431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77bd6f-c654-4017-a8fe-e8e472473f54 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:52.212992 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 197/399] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:52 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:52.221277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.235863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68eeb-786a-43f5-a250-cf776585c6bd None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.236150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68eeb-786a-43f5-a250-cf776585c6bd None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.236353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68eeb-786a-43f5-a250-cf776585c6bd None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.238012 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 198/400] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:52.243948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.244233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.244516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.263415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:52.264610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:52.275821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:52.341963 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 199/401] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:52.358349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.446732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8393c29-642e-4cf5-bc97-0969e7031b70 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.484128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be243-567a-4966-8d54-e8ad680e067f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.518698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:52.523227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.523891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.524169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.524442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.531467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:52.532923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:52.533292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.533995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.534287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.534571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.535554 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 203/402] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:52 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:52.541515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.557738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:52.565391 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:52.567764 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:52.569119 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 200/403] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:52.575852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.716206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:52.727702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57985fd-68f8-4af0-bd75-9991858ddc60 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.774866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d1d1-b8e2-421c-a366-ebe495e13ed7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:52.792387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.793046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.793326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.793594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/groups/0ab055b20ff244a589fe979281b33cef/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.796924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, group_id=0ab055b20ff244a589fe979281b33cef, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:52.798447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:52.824211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:52.824864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:52.825145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:52.825423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:52.826150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:52.826504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:52.827929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:52.837895 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 201/404] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:52.843370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:52.898498 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 204/405] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Aug 7 00:58:52 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/groups/0ab055b20ff244a589fe979281b33cef/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:52.906430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:52.965310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcd08b-9233-4bfc-aa1e-551eebf1a83c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.008223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.009184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.009704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.010141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] PATH_INFO: `/v3/groups/3423e2cf308244118f52c7ef99d31eb4` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.011843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] RBAC: Authorizing `identity:get_group(group_id=3423e2cf308244118f52c7ef99d31eb4)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:53.013651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb2ad-1987-49e1-9851-24363763ca51 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:53.015959 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 202/406] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:52 2022] GET /identity/v3/groups/3423e2cf308244118f52c7ef99d31eb4 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:53.022688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:53.139849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede48fd1-e399-4bdc-8ec1-a64e0a7faa66 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.164814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea63ac-c29d-4177-b89c-b881a7cb7d3c None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.165324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea63ac-c29d-4177-b89c-b881a7cb7d3c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.165530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea63ac-c29d-4177-b89c-b881a7cb7d3c None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.166816 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 203/407] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:53.173379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.173936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.174237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.192282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.192941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.193228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.193510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] PATH_INFO: `/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.194713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4d8f722b65514efcbdc7ef3dc7a594c9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:53.195973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:53.196173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:53.197165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:53.198164 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 205/408] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:53 2022] GET /identity/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:53.205059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:53.245444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:53.291438 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 204/409] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:53.318576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:53.335264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718e331-0869-4c86-8f91-efaea18f87a9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.375250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:53.379446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.380201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.380486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.380766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] PATH_INFO: `/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9/groups/3423e2cf308244118f52c7ef99d31eb4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.382852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d8f722b65514efcbdc7ef3dc7a594c9, group_id=3423e2cf308244118f52c7ef99d31eb4, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:53.387275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:53.444300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70135a4-5e8d-43bf-932b-417b880c5e41 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.488958 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 206/410] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Aug 7 00:58:53 2022] PUT /identity/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9/groups/3423e2cf308244118f52c7ef99d31eb4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:58:53.489360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.490120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.490401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.490718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.510416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:53.515640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:53.518220 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:53.520217 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 205/411] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:58:53.527787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:53.652413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:53.670516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303d70e-154f-4841-84ad-8adf86992161 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.709769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.710351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.710666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.711024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.711695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:53.712010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:53.713395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a65-e665-4660-9ab8-9cfa7278b59c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:53.722272 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 207/412] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:53.728387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:53.846480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69b23-3bac-4d0e-918f-ed5d92e6ab04 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.846824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69b23-3bac-4d0e-918f-ed5d92e6ab04 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.847049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69b23-3bac-4d0e-918f-ed5d92e6ab04 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.848772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 208/413] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:53.855282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300384-68bc-49b5-9285-b851de916ecc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.855574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300384-68bc-49b5-9285-b851de916ecc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.855855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300384-68bc-49b5-9285-b851de916ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.878567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-52300384-68bc-49b5-9285-b851de916ecc None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:53.880088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52300384-68bc-49b5-9285-b851de916ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:53.892535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a50e6-4cac-4c45-9051-c7fed6bd10b3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:53.914224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:53.970325 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 209/414] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:58:53.984109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:53.984766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:53.985049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:53.985328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:53.986598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:53.988210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9ab9-7c88-4fa0-b3f5-ef28f4c3dadb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:53.990046 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 206/415] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:53 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:53.995337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52300384-68bc-49b5-9285-b851de916ecc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.006976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972fa49-a527-4821-9716-c8ba875c92ba None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.007307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972fa49-a527-4821-9716-c8ba875c92ba None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.007535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972fa49-a527-4821-9716-c8ba875c92ba None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.009469 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 207/416] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:54.010202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972fa49-a527-4821-9716-c8ba875c92ba None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.084956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.108778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52300384-68bc-49b5-9285-b851de916ecc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.144399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972fa49-a527-4821-9716-c8ba875c92ba None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.148205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.148840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.149120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.149395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.150587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:54.152034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0510a8-d859-4ab2-ab44-dd9595cc832c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:54.157904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 210/417] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:53 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:54.160369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.160669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.161019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.179982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:54.181271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:54.191022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.193080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.194021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.194779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.212492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:54.217640 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:54.218533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:54.219317 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 208/418] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:54.219968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.260386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.269986 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 211/419] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:54.270904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.333759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295493-e406-4e77-8be1-aef3a447c4a9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.367914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.372001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.372674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.372961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.373238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce/groups/0ab055b20ff244a589fe979281b33cef/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.375756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc837d07c049d8a01cb68346867bce, group_id=0ab055b20ff244a589fe979281b33cef, role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:54.377203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:54.393395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcb35d-84fb-4189-96fd-2ca9db7803f0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.430927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.431576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.431857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.432143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.432861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:54.433165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:54.434644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:54.445791 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 212/420] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:54.447489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.478294 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 209/421] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Aug 7 00:58:54 2022] PUT /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce/groups/0ab055b20ff244a589fe979281b33cef/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:58:54.486378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.612793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33740-961b-4b89-b243-47067054eb58 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.693557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.694403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.694689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.694972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.698283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.698798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.705670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b68d-1cfb-4c79-8c80-a2c838520222 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.709961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:54.715069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:54.722888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 213/422] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:54.724816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.747197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.747820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.748100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.748461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.832671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:54.834403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:54.857911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338a23-ea3d-4443-b1dc-9217f536e6e1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:54.897992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:54.898592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:54.898924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:54.899205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:54.899877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:54.900186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:54.901584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:54.911331 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 214/423] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:54.916885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.944971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:54.958197 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 210/424] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:54.961682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:54.997370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.071028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920ce5-099b-4e74-aee8-9cea97561da6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.135358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.136099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.136377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.139722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.163927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a301-230f-4e2d-a9b9-99e35f0b1d13 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.236701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.237455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.237618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.238426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.240587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.242081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.244058 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 211/425] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:55.259089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:55.289881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.291368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.383166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.411040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.432587 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 215/426] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:55.438341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:55.509599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf52f6-a345-493a-b7a9-876babfd7135 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.573956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec9274-f0ba-4cc8-8ded-0dbe92c4af34 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.584280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.585210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.585721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.586374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.587740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.589604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804eab-ca01-4014-8090-fb9b47eeb15e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.591779 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 212/427] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:55 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:55.599482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa8f0-2f33-4e14-82f1-12a4009fb618 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.599768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa8f0-2f33-4e14-82f1-12a4009fb618 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.600043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa8f0-2f33-4e14-82f1-12a4009fb618 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.605013 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 213/428] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:58:55.605776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa8f0-2f33-4e14-82f1-12a4009fb618 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:55.622824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.623922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.624203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.624620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] PATH_INFO: `/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.626148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] RBAC: Authorizing `identity:get_project(project_id=69e7cd04e9d74a3db9f85eeea68ad398)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.628017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a921-c7c5-499f-adfa-e20201eb81eb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.631121 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 216/429] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:55 2022] GET /identity/v3/projects/69e7cd04e9d74a3db9f85eeea68ad398 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:55.632321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.632606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.632880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.654125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:55.656078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:55.685431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.734290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa8f0-2f33-4e14-82f1-12a4009fb618 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.743186 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 217/430] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:55.743859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:55.775492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.783062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.784901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.785639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.786137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.788116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:55.788116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.789432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267855aa-9062-498b-b359-6c39ee9d3aaf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.797807 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 214/431] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:55 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:55.799086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4533-8685-4da4-a74a-7a1a7357e650 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.799372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4533-8685-4da4-a74a-7a1a7357e650 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.799644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4533-8685-4da4-a74a-7a1a7357e650 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.801585 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 215/432] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:55.806604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a4533-8685-4da4-a74a-7a1a7357e650 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:55.880949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0996d82-c0ef-4e9c-928d-316ea819ba4f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.923106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.923758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.924511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.924794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.926791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:55.928309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2d65-3167-403d-aa95-9b7219bbbe9a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:55.930251 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 218/433] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:55 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:55.934847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.934847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.934847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.943722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a4533-8685-4da4-a74a-7a1a7357e650 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:55.954295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:55.956035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:55.977803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:55.995183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:55.995856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.996113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.996389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.012950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:56.019003 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:56.020459 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:58:56.021376 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:56.025745 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 216/434] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:56.029433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.041279 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 219/435] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:56.042441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.100616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.146000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7d5c-7c19-4ea9-90c4-ee619827a441 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.155511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1fed-5eb3-492c-9d07-004dccc9e516 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.180650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.181288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.181521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.181793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.182600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:56.182839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.184269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.190157 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 217/436] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=69e7cd04e9d74a3db9f85eeea68ad398&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:56.190817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.203913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.205342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.206147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.207469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.208637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:56.209155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.211712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.224264 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 220/437] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:56.230889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.254818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.312722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2dc1-3789-463e-9571-bad12d4f330d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.337129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.352762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.353710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.353873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d426-8e8c-42f2-b378-9e4fc0187fc1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.354281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.354695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.370348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:56.375806 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:56.376686 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:56.377474 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 218/438] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:56.384903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.409005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.409614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.410057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.410336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.505309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.506859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.517131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd21c-6ac5-4db3-879e-2868a474a0d2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.529010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.569127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.571051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.571051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.571051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.571051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:56.571345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.572617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.582778 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 219/439] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:56.588668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.641868 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 221/440] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:58:56.645496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.646662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.735094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca8db-0f9d-451f-abd7-0a1f0e88c93c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.778583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ae8-dd5f-499c-9a08-24ebdbae1738 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.780820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.781447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.782745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.782745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.802598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.834113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.834655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.834942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.835225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.836871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.838386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.840367 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 222/441] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:56.845728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.877264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.879719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc6983-d89e-4ba9-a0b5-87e839899fa5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.922359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.953077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb879cf-42c8-4fc8-8746-3b138ea681f8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.982640 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 220/442] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:56.983946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c95f6-979d-416b-9b89-227f5852d44c None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.984238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c95f6-979d-416b-9b89-227f5852d44c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.984512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c95f6-979d-416b-9b89-227f5852d44c None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.985753 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 221/443] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:56.990767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c95f6-979d-416b-9b89-227f5852d44c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.991053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.991676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.991955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.992226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.993316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.994793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c2679-81ce-49b8-86c0-e1e55554e198 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.996337 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 223/444] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:56.997401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.997680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.997977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.015031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:57.016208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:57.061958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.081231 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 224/445] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:58:57.083292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.091179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c95f6-979d-416b-9b89-227f5852d44c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.124566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.125189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.125467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.125737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] PATH_INFO: `/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.126863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] RBAC: Authorizing `identity:get_project(project_id=4d8f722b65514efcbdc7ef3dc7a594c9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.128300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.130747 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 222/446] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/projects/4d8f722b65514efcbdc7ef3dc7a594c9 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:57.131489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.142812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.186022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e107bb-10e7-4cc4-a6eb-351c6201700f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.220343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.220933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.221208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.221474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.222270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=f097b8e696684df78b8f3a53be01a5d9, scope.project.id=c0fc837d07c049d8a01cb68346867bce) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:57.222575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.224020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.229052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43796-e98d-4994-b28b-bc8bf754ef40 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.229626 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 225/447] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=f097b8e696684df78b8f3a53be01a5d9 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:57.230413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.279075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.280175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.280463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.281078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.285223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.293217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:58:57.298380 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:58:57.302183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:58:57.303188 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 223/448] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:58:57.307239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.350793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855e86-7778-4c65-8598-49018bb0dda1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.386753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.389274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.390008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.390391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.390668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] PATH_INFO: `/v3/groups/3423e2cf308244118f52c7ef99d31eb4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.392564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] RBAC: Authorizing `identity:get_group(group_id=3423e2cf308244118f52c7ef99d31eb4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.394082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.396439 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 226/449] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/groups/3423e2cf308244118f52c7ef99d31eb4 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:57.402101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.422630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396086-d0ff-47c5-9c6c-e24de4ae8182 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.461677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.462427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.462702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.462985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.463659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:57.463971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.465409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.474984 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 224/450] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:58:57.479714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.528189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045c8e-ed1c-41e1-93db-16c81d3a8566 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.543100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.569511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.570255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.570666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.570963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.571731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] RBAC: Adding query filter params (group.id=3423e2cf308244118f52c7ef99d31eb4, role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=4d8f722b65514efcbdc7ef3dc7a594c9) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:57.572040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.573607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.581291 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 227/451] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/role_assignments?group.id=3423e2cf308244118f52c7ef99d31eb4&scope.project.id=4d8f722b65514efcbdc7ef3dc7a594c9&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:57.595866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e80f7-f26b-4913-b9c7-be5fbf5fe1cc None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.631152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:57.636414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.637053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.654280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.654280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.708472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.710013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.809073 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 225/452] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:58:57.814771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.911305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0895-6a71-407e-ae8d-1070a34b6038 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:57.943230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:57.943842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:57.944124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:57.944400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] PATH_INFO: `/v3/projects/c0fc837d07c049d8a01cb68346867bce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:57.945624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] RBAC: Authorizing `identity:get_project(project_id=c0fc837d07c049d8a01cb68346867bce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:57.947109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:57.948707 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 228/453] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/projects/c0fc837d07c049d8a01cb68346867bce => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:57.954126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:57.984395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:58.055425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5604c-953a-457c-8a04-5c3b4b496220 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:58.088204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:58.088824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:58.089106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:58.089384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] PATH_INFO: `/v3/groups/0ab055b20ff244a589fe979281b33cef` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:58.090503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] RBAC: Authorizing `identity:get_group(group_id=0ab055b20ff244a589fe979281b33cef)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:58.091948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69abdb-40b2-46be-8b01-610f104b8646 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:58.093513 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 226/454] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Aug 7 00:58:57 2022] GET /identity/v3/groups/0ab055b20ff244a589fe979281b33cef => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:58:58.099494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:58.145595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:58.196617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee7c12-9163-4d7d-b4d9-4ba2f04c053c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:58.227886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:58.228466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:58.228747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:58.229021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:58.229727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] RBAC: Adding query filter params (group.id=0ab055b20ff244a589fe979281b33cef, role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=c0fc837d07c049d8a01cb68346867bce) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:58:58.230067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:58.231509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c3a6-1262-4f02-83de-1a69fa74bf32 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:58.236981 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 229/455] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Aug 7 00:58:58 2022] GET /identity/v3/role_assignments?group.id=0ab055b20ff244a589fe979281b33cef&scope.project.id=c0fc837d07c049d8a01cb68346867bce&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:00.942391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18e3-1612-475f-83fe-5658b3153666 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:00.949692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18e3-1612-475f-83fe-5658b3153666 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:00.949692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c18e3-1612-475f-83fe-5658b3153666 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:00.949692 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 227/456] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:00.949939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:00.949939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:00.950377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:00.995039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:00.996268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:01.004085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9216-611a-429d-982a-20b72afc989d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.010285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9216-611a-429d-982a-20b72afc989d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.010285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9216-611a-429d-982a-20b72afc989d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.010285 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 228/457] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:01.015261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.015849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.016470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.072276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:01.079485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:01.197129 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 230/458] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:01.233057 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 229/459] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:59:01.241999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.266596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.300079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.309359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.378876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa89645-fcb6-4055-9ad3-b2a3134f3ea2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.401472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11e642-9f13-4b39-bc69-3423f11ea09f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.437345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.437896 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.438015 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.438406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.438689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.439250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.439712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.440184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.452612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.454418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.454722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.456688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-13007cd5-9aed-402c-9931-ce800fa7b22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:01.470800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:01.471732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:01.473078 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:01.473078 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.473078 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:01.475162 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 230/460] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:01.481859 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:01.482751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:01.483604 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:01.483604 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.483604 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:01.483604 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 231/461] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:01.483819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e9c-5fca-4626-9769-a4fc563aa324 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.483819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e9c-5fca-4626-9769-a4fc563aa324 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.483819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6e9c-5fca-4626-9769-a4fc563aa324 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.483819 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 231/462] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:01.484035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.489549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.489549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.489549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.513964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:01.515439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:01.586361 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 232/463] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:01.587519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.602803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.612334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.622272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b17-333d-416d-98b6-4ac34a3e5166 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.655168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.655796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.656066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.656336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.656983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:01.657289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.658753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a397-ac2a-4b6b-a321-b5aa2d398824 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.677512 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 232/464] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:01.679516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af65c-bc99-46a5-9f44-a8e29800c410 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.680265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af65c-bc99-46a5-9f44-a8e29800c410 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.680743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af65c-bc99-46a5-9f44-a8e29800c410 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.682671 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 233/465] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:01.683833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af65c-bc99-46a5-9f44-a8e29800c410 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.691660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8a69-0a0c-46a3-8621-6e8768b25c8e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.730963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.731634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.731759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.732042 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.732688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:01.732995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.734429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.751324 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 233/466] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:01.751324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:01.803298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af65c-bc99-46a5-9f44-a8e29800c410 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.824883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.839097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.839721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.839997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.840269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.851891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.853455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.855245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a73a4-11f9-496e-b57c-745dd34a74aa None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1a7709c2-d2fe-476a-893d-31cc283673cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:01.867720 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:01.868633 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:01.869511 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:01.869511 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:01.869511 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:01.869511 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 234/467] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:01.870233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.870233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.870499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.878355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:01.889231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:01.890438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:01.901230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:01.901858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:01.902167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:01.902450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:01.903142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:01.904622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:01.961070 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 235/468] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:01.961946 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.033872 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 234/469] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:01 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:02.033872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.094521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77135c0-4a74-4385-8ed6-8b6d83e730a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.134879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.135656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.136042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.136435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.137181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.138817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.145890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1332e-c6e3-49e4-9cb1-843be4a229f7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.154222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.178354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.189220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.189851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.190147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.190419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.191096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:02.191400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.192839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.204779 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 235/470] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:02.205581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.235702 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 236/471] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:01 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:02.236425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.355308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4ca99-01c3-445c-99d8-fb85fb4d766e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.388114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f117bae-8e0e-490b-8db5-8a0b21ee2d2c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.394465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.395195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.395546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.395894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.407449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.409013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a32a3f6f-fbf2-4abf-8d11-4fffe697eea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:02.426722 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:02.427874 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:02.428786 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:02.428786 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:02.428786 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:02.430587 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 236/472] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:02.431901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3055-912b-42b8-810d-1478e780507b None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.436558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.436558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.436558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.436558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.436931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.436931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a82f8-3d86-4060-835f-3670bb560858 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.437451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3055-912b-42b8-810d-1478e780507b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.437888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3055-912b-42b8-810d-1478e780507b None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.439351 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 237/473] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:02.440189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf3055-912b-42b8-810d-1478e780507b None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.489243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.542934 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 237/474] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:02 2022] POST /identity/v3/users => generated 249 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:02.544920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.551116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.551479 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.564671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf3055-912b-42b8-810d-1478e780507b None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.589261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:02.591407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:02.637587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.638277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.638559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.638834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.639501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:02.639807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.645444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.668421 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 238/475] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:02.672214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.674251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.700104 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 238/476] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:02.733815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:02.819487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.825858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe2da3-ba8c-491c-be5e-1cd9920d7dcd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.869240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853fa3-8668-43da-9710-858dc9e4451c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:02.876511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.877196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.877481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.877757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.880100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.881597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.918125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:02.918774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.919062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.919332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.920003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:02.921453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:02.975025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.sql.core [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:59:02.975025 dv-cinder-master-3-smb devstack@keystone.service[80508]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:59:02.975025 dv-cinder-master-3-smb devstack@keystone.service[80508]: [parameters: {'id': '65692a283c234c58be51efc7e11b7e19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:59:02.975025 dv-cinder-master-3-smb devstack@keystone.service[80508]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80508) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:59:02.983317 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 239/477] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:02 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:02.994298 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:02.998984 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application yield resource Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise self.value Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application session.commit() Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:59:02.999898 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:59:03.002219 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:03.004994 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:03.007116 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [parameters: {'id': '65692a283c234c58be51efc7e11b7e19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:03.009259 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:59:03.018376 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:03.021122 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 239/478] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Aug 7 00:59:02 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:03.021224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:03.182113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089dc-2bc5-4159-88ca-a1f2e484d79e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:03.227398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:03.228040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:03.228325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:03.228604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:03.239547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3b3c62df-ac81-4dde-952e-2c464dbb19bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:03.244817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:03.246962 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:03.248923 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 240/479] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:03.255099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:03.310582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:03.370961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cde9-dfd3-4581-81d6-183df25fdd1a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:03.405519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:03.406665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:03.407199 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:03.407669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:03.408557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:03.409063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:03.411485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8f09c-f5f9-4a8c-b2a5-fcf9d52294f2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:03.421847 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 240/480] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:04.467054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a4c0-ee69-481b-bc1a-9863c48be060 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.467569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a4c0-ee69-481b-bc1a-9863c48be060 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.467642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a4c0-ee69-481b-bc1a-9863c48be060 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.469206 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 241/481] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:04.474692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f3bf-a9bd-4d6b-997a-7806eb31043f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.475093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f3bf-a9bd-4d6b-997a-7806eb31043f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.475257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f3bf-a9bd-4d6b-997a-7806eb31043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.503342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1155f3bf-a9bd-4d6b-997a-7806eb31043f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:04.504726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1155f3bf-a9bd-4d6b-997a-7806eb31043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:04.589577 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 241/482] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:04.639391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a4c0-ee69-481b-bc1a-9863c48be060 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:04.663738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:04.765215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a4c0-ee69-481b-bc1a-9863c48be060 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:04.801019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:04.801659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.801974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.802257 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.813634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:04.819591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:04.820497 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:04.821340 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:04.821971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99a76-4f1c-434e-9464-d66771b02d21 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.821971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99a76-4f1c-434e-9464-d66771b02d21 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.821971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99a76-4f1c-434e-9464-d66771b02d21 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.822156 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 242/483] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:04.823591 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 242/484] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:04.826367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:04.828381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d6f7-c0b8-4653-b1cb-b859d06c3ae3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.828768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d6f7-c0b8-4653-b1cb-b859d06c3ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.829149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d6f7-c0b8-4653-b1cb-b859d06c3ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.867383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6426d6f7-c0b8-4653-b1cb-b859d06c3ae3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:04.869404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6426d6f7-c0b8-4653-b1cb-b859d06c3ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:04.930195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:04.949045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:04.988449 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 243/485] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:59:04.990497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edddc7-63b7-46d1-9ecb-c55bd69c07ec None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.990497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edddc7-63b7-46d1-9ecb-c55bd69c07ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.990497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edddc7-63b7-46d1-9ecb-c55bd69c07ec None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:04.992369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21f342-6565-4274-8d8a-8f366ae72821 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:04.995713 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 244/486] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:04.996779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:04.997062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:04.997335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.032025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:05.033128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:05.036097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.037235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.038800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.039345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.040224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:05.040745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.042403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.054447 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 243/487] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:05.055499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.118479 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 245/488] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:05.119722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.172431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe0ae-2f4c-4bda-82a0-8a6172c0e9a9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.219789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.220835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.221123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.222219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.232831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.235971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.242926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:05.245927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ad9b-8b7c-402f-94e9-e2f5652966aa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:05.249277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:05.250205 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:05.251059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:05.253923 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 244/489] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:05.254861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.295385 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.296791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.297079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.297353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.311519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.313617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:05.333503 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:05.335650 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:05.337776 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:05.337776 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:05.337776 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:05.337776 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 246/490] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:05.337776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.372398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d33f-5a41-410a-aa16-8e93c5ba45d3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.410949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.411676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.411960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.412233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.423517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:05.429858 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:05.431876 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:05.433750 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:05.441854 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 245/491] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:05.441854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.463743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0cb63-055c-43dd-90cf-ab465ab28aa5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.500764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.510556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.511294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.511576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.512006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.519453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:05.519453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.519453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.525535 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 247/492] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:05.526736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.542185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.552164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611fcf8-241f-449a-85cd-55d1702e3f6a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.590998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.591968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.592351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.592747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.593571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:05.594024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.595550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.610097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 246/493] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:05.616292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.653720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744d524-5c49-4638-a47c-f2e4ebf7d40b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.688853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.689641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.690074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.690537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.691469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:05.691677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.693248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.702039 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 248/494] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:05.708074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.744903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669625-f553-45d9-b992-b62d063956fd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.762804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.779446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:05.780927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.781548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.781856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.782123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.792926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.794662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-b31891dd-5adc-43b0-ad5e-a053078a9f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:05.810838 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:05.811725 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:05.812559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:05.812559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:05.812559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:05.812559 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 247/495] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:05.813330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608d5c-ed7e-4fd8-9828-94d80b6b54e9 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.813330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608d5c-ed7e-4fd8-9828-94d80b6b54e9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.813589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608d5c-ed7e-4fd8-9828-94d80b6b54e9 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.814988 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 248/496] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:05.819929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a608d5c-ed7e-4fd8-9828-94d80b6b54e9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.820782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8041c-410d-4601-ab66-8f23aa0f94bd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.860721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.861494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.861782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.862114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.872803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.874561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:05.892289 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:05.893201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:05.895125 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 249/497] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:05.895750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:05.937366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a608d5c-ed7e-4fd8-9828-94d80b6b54e9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:05.971079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:05.972323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:05.972611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:05.972887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:05.991368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:05.992842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3e8c4b3a-ee34-4afa-b0cc-37148f2c2033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:06.006682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:06.007594 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:06.008451 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:06.008451 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:06.008451 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:06.008451 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 249/498] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:06.009175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.009175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.009442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.015026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8b00-a942-4f44-9273-701b7c0800ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.027262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:06.028790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:06.043740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.048481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.052070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.056245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.072101 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 250/499] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.072101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.107498 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 250/500] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:06.108611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.180186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77a662-b454-40f9-a2a1-c93334b55979 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.216520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.217005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ca6a0-a97d-4f4a-8ae7-9d97e0fca240 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.217121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.217391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.217667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.218427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.218735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.220178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.250581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.251179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.251459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.251732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.252372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.252672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.254616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.256300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 251/501] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.257122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.270898 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 251/502] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.271711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.286272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.306226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.356552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8389f-e05d-4d70-91d6-54eeb54305cb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.368369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf976fd0-32a4-4b44-8ebd-74f3196fc853 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.391099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.391744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.392027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.392299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.400181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.400644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.401259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.401537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.401668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.401810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.412162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a09a0209-9670-40a1-a0ce-1700ecf39d1d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:06.413934 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:06.414797 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:06.415673 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 252/503] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:06.416223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab766-af59-4f17-8d8b-7bb05cb9baf0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.416595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab766-af59-4f17-8d8b-7bb05cb9baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.416738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab766-af59-4f17-8d8b-7bb05cb9baf0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:06.417192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:06.418010 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:06.418789 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:06.419377 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 253/504] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:06.419377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab766-af59-4f17-8d8b-7bb05cb9baf0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.420547 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 252/505] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:06.421341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.494840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.520980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab766-af59-4f17-8d8b-7bb05cb9baf0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.525827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6d8c8-8eba-4f2c-837d-b073eff8fded None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.527848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.555444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.556038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.556314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.556587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.561044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.561665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.561986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.562265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.569820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.571298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:06.584134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:06.585164 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 253/506] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:06.586571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.626262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.627707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2542c-1963-45bd-9946-1fe8e1152284 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.687465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55836abd-0501-4895-b7fc-e761139ec862 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.715866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.720828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.721971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.722301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.722577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.723271 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 254/507] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:06.723367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.723598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.724575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.724869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.725050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.725147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.736657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.743122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:06.744321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:06.761542 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 254/508] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.763471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.809974 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 255/509] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:06.810820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.874671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441f22-0ae4-4763-9463-c3665ab5974d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.915161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.915696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.915976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.916253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.916914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.917456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.918627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.922711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59a89-d166-4b77-8e51-f073391fb99e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:06.927245 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 255/510] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.928029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.956962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:06.957564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:06.957865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:06.958132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:06.958850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:06.959153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:06.960575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:06.963030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:06.981485 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 256/511] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:06.982355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:06.983993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.034665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae37ebb-80e2-451f-90c9-d94ebe874ff7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.075877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.076498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.076782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.077061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.085599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc2300-488f-4cec-a689-089ebfb71aa7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.088007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.089460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:07.103902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:07.104973 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:07.110587 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:07.110587 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.110587 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:07.110587 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 256/512] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:07.110587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.120175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.120788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.121072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.121350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.184747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.191594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.193158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.210786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351a11-9192-4631-876d-f0bd5e61d7aa None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.213096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.243511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.244131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.244420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.244697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.254702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.256155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:07.271270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:07.272265 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:07.273098 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:07.273098 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.273098 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:07.273098 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 257/513] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:07.273308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.296348 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 257/514] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:07.297109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.374442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32f47-c8d9-4818-a951-88b71418409f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.389738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.396829 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69de4a-c9a0-42b6-a393-f723dc12b1e1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.408494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.409136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.409415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.409767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.420333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.421999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.429788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.430409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.430686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.430959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:07.435760 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:07.436815 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:07.437662 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:07.437662 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.437662 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:07.437662 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 258/515] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:07.437662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.452632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.500496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.501990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.538686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac8be-fba7-483d-986e-99b333a9f7ae None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.571224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.571906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.572193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.572470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.573108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:07.573414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.574831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.586432 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 259/516] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:07.587216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.597133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.604623 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 258/517] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:07.605416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.657181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.689935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c77b-a530-476a-9fd4-78baab8cb931 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.701609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822bbd1-c794-4570-89ad-c906825697a2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.724359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.724964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.725247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.725526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.726198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:07.726510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.727881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.734734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.735344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.735623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.735899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.739520 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 260/518] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:07.740459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.746838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.748327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:07.762656 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:07.763568 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:07.764401 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:07.764401 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:07.764401 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:07.764401 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 259/519] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:07.764610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.812583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.843696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa61a-3ad4-400f-8495-83ca1c4b85ea None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.866014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569079b9-8a05-4a7c-9d45-bdfbe01530cb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:07.869674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:07.877170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.880889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.892048 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 261/520] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:07.892831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:07.899990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:07.900619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:07.900905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:07.901189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:07.907949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:07.910093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:07.921508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:07.922416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:07.923269 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 260/521] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:07.923726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.020368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edc0a-2b12-4e9a-af1a-a374f47f6124 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.028379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.055856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.056461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.056747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.057025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.057667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.059277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.061067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0c918-bcea-419b-bb45-a7a93b5913ca None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.095359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.096003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.096286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.097164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.106987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.110011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:08.123372 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:08.124428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:08.125316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:08.125316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:08.125316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:08.125316 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 262/522] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:08.125316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.134305 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 261/523] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:07 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:08.135121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.174611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.238773 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595a07c-d85c-415c-a564-9209f1c75fd1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.273176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb61a-f617-446b-8a71-6a731d273a19 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.276350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.276971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.277253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.277527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.278205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.278514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.279897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.294284 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 263/524] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:08.294811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.312735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.313367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.313639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.313952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.323054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.324700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:08.338276 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:08.339191 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:08.340065 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:08.342120 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 262/525] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:08.342787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.371554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.404740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.408972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397f82-c3a7-4bec-b7c6-b5db3b822b43 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.444277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.445022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.445306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.445595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.446300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.446606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.447668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b173ee-df3c-462a-b0df-bdd4896ef77f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.448034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.467006 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 264/526] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:08.467636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.491977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.492670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.492957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.493558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.494525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.494841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.496725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.515878 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 263/527] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:08.515878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.572710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8e131-9ac3-47ac-8e77-f93b6eaff1df None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.606688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.607304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.607584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.607852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.611416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.615339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.616828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:08.629634 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:08.630731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 265/528] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:08.631578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.639171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e36760-b9e4-4dff-92be-30e9ef1e93ef None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.658401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.676988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.677866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.678322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.678746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.679617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.680071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.681661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.702880 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 264/529] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:08.704196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.741541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86557a1-8133-4167-a2a5-e6dafe1256b7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.780382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.781010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.781293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.781573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.782324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.782636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.784143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.801871 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 266/530] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:08.801871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.825769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8c1eb-7e21-4d7e-b080-e4b5f1010255 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.875421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.876430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.877123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.878784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.890030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.891834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:08.897485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.904792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:08.912974 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:08.914081 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:08.915128 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:08.918071 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 265/531] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:08.919307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:08.932923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ad9b-8017-4e57-92cc-01e2e2fb8152 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:08.990890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:08.991506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.991789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.992064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.992760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:08.993068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:08.994732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.007512 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 267/532] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:09.008047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.058435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e498c1-0922-4676-ba1d-c40a70951769 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.105038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.106545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.106825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.107097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.120233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57261157-5ddd-4798-aeb0-6334a05c2a2a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.155914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.156524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.156805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.157082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.157778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:09.158130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.159646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.177099 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 268/533] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:09.177099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.183184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:09.199808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:09.203445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.206707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.287538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b968e2-f69c-476f-b245-4e30aae376f2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.332299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.333185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.333661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.334134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.335046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=37ad903b3fcf4e1f90c6c8d2c716d3f1) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:09.335528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.337200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.339338 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 266/534] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:09.340243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.345468 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 269/535] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/role_assignments?user.id=37ad903b3fcf4e1f90c6c8d2c716d3f1&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:09.347239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.423375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:09.466392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c058b2-10ab-489e-a4be-2f5ce1695759 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.486112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:09.491323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa667-2b0e-4bab-bcf0-9e24af4d7e8c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.543674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.545184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.547053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.547949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.548470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.550050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=c6ee4ba08ab84302b567df30df796e5c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:09.551000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.551500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.551995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.552533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.554847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.576491 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 267/536] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/role_assignments?user.id=c6ee4ba08ab84302b567df30df796e5c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:09.580005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.583313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:09.604394 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:09.605365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:09.606259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:09.606259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:09.606259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:09.606259 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 270/537] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:09.611562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.768672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e468fc5-e2f9-4897-a2d0-4a2ba774487a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:09.809101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:09.809798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:09.810106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:09.810382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:09.811029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:09.811332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:09.812770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:09.833856 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 268/538] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:09.838963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:09.983994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d63d-3791-48ab-88d7-2e6cd5b3ffde None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:10.015751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:10.040149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:10.040791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.041070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.041338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.048404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:10.050142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:10.065487 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:10.066474 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:10.067336 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:10.070030 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 271/539] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:10.072715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:10.113322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:10.198878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f6df-aede-434f-87d9-54e70c9137d6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:10.233307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:10.234113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.234400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.234730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.235423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:10.235728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:10.237260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc310-8c6a-4675-9875-a4ce04ccb5e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:10.255331 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 269/540] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:10.260825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:10.407800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144728cb-76ff-4f4b-a8ec-c17ed6d4e76d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:10.443288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:10.444281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.444790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.445275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.446236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=5e19c7f04deb4b04b4c2d98ca7323b84) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:10.446753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:10.448378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745a7e-6ade-4ce7-a85c-1db1c8eaa4dc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:10.454735 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 272/541] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:10 2022] GET /identity/v3/role_assignments?user.id=5e19c7f04deb4b04b4c2d98ca7323b84&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:10.470430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e2-ea53-4090-8e04-b51197794233 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.470738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e2-ea53-4090-8e04-b51197794233 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.470992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a2e2-ea53-4090-8e04-b51197794233 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.473121 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 270/542] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:10.478754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.479039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.479319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.498223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:10.499472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:10.546545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:10.595725 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 273/543] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:10.635033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a2e2-ea53-4090-8e04-b51197794233 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:10.749524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:10.769339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a2e2-ea53-4090-8e04-b51197794233 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:10.809822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785044e-8827-4258-93fb-c9769293485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:10.810492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785044e-8827-4258-93fb-c9769293485b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.810776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785044e-8827-4258-93fb-c9769293485b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.811050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785044e-8827-4258-93fb-c9769293485b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.821446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785044e-8827-4258-93fb-c9769293485b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1785044e-8827-4258-93fb-c9769293485b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:10.826217 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:10.827093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:10.828076 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 271/544] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:10.834463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:10.942052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d238ac0-b96c-4445-8bc7-200d74cec37e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:10.989858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:10.989858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:10.989858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:10.989858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:10.990188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:10.990188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:10.990188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:11.001079 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 274/545] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:11.006699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785044e-8827-4258-93fb-c9769293485b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.123751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785044e-8827-4258-93fb-c9769293485b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.170221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:11.170853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.171134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.171407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.185630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:11.187142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:11.189900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-90d7596b-5403-470c-b8d7-642107de9904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:11.208157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:11.222864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:11.223716 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:11.223716 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:11.223716 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:11.223716 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 272/546] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:11.224024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.240934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf52dc-46a3-40ec-9485-6526a1ee4b4b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.241240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf52dc-46a3-40ec-9485-6526a1ee4b4b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.241496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf52dc-46a3-40ec-9485-6526a1ee4b4b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.246126 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 273/547] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:11.248440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.248801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.249154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.278255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:11.281654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:11.284119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:11.385249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28768f-5e70-4005-956e-734de5869b51 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.399241 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 274/548] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:59:11.421804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.453494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:11.454150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.454449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.454648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.455295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:11.455650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:11.461400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:11.487466 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 275/549] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:11.492889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.566544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68f888-b918-4409-bf29-74a53a8ec199 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.593353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:11.610370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:11.611004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.611285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.615848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.622196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:11.630780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100611a-4999-4fbb-a4c3-86442a994ed3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.642594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:11.650137 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:11.661946 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 275/550] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:11.662761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.682458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:11.683096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.683382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.683661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.695134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:11.696607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:11.719137 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:11.720315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:11.721300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:11.729668 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 276/551] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:11.735853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:11.853505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555bb21-5425-4e56-93bb-fe003fffdbd3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.923327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:11.923936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.924301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.924616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.925279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:11.925578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:11.926990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:11.932248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aded8-5960-4234-8fb9-ca0f296287db None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:11.946569 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 276/552] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:11.951016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.019192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.020429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de04a2-029d-4f79-8722-830e360179da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.021095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de04a2-029d-4f79-8722-830e360179da None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.021372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de04a2-029d-4f79-8722-830e360179da None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.021641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de04a2-029d-4f79-8722-830e360179da None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.022401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de04a2-029d-4f79-8722-830e360179da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:12.022705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de04a2-029d-4f79-8722-830e360179da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.024124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de04a2-029d-4f79-8722-830e360179da None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.069528 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 277/553] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:12.074957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de04a2-029d-4f79-8722-830e360179da None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.090990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d9ea-eab7-4923-b86f-3551665e4cf9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.110996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.164192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.164192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.164192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.164192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.166459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.167924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e6ff387c-0a00-4966-a1ce-05602a30c5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:12.182445 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:12.183394 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:12.184292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:12.184292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:12.184292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:12.184292 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 277/554] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:12.185057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f3a7-f102-4002-994b-ad2af9b70150 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.185057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f3a7-f102-4002-994b-ad2af9b70150 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.185212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f3a7-f102-4002-994b-ad2af9b70150 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.190461 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 278/555] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:12.192206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c437-016a-49c1-98d2-9f84b005b97f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.192504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c437-016a-49c1-98d2-9f84b005b97f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.192784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c437-016a-49c1-98d2-9f84b005b97f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.194195 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 279/556] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:12.195967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c437-016a-49c1-98d2-9f84b005b97f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.222779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de04a2-029d-4f79-8722-830e360179da None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.258286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.259226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.259661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.259940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.310537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.315865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c437-016a-49c1-98d2-9f84b005b97f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.335934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.338169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06f9b2-f318-427d-af3e-c57528107eca None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.351553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.352667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.352954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.353236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.353922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:12.354236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.355612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d569-d101-498b-a026-3b7793749a24 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.356576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.372495 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 280/557] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:12.372495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.372495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.372495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.388732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:12.389870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:12.453816 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 278/558] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:59:12.455105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.455416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.455714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.461475 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 281/559] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:12.462711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.477747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:12.479358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:12.548944 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 279/560] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:12.551066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.579347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.590152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73e777-0d9f-4ce2-82a9-fcc8964d075b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.603558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.626213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.626774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.627058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.628027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.636139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.637607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:12.650111 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:12.656515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 282/561] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:12.657651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.674991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834855-e84c-4b2f-91bb-2a0fb0e63c4a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.712736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.713444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.713636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.713935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.725476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.727591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:12.742712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:12.743917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:12.749910 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:12.749910 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:12.749910 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:12.749910 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 280/562] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:12.749910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.775162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025784dd-c610-4248-9bfa-e4a75730f810 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.808674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.809307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.809587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.809880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.820122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:12.825130 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:12.826255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 283/563] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:12.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.839878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.846715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:12.852428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5a04-0f00-4c53-ba93-80548f4177d5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.885540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.886127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.886416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.886695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.899291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:12.903964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:12.904995 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:12.905975 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:12.911011 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 281/564] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:12.911856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:12.927220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d201-8b60-4eb2-89b0-a4cddf59a5fc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:12.960593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:12.961276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:12.961555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:12.961850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:12.962588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:12.962895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:12.964336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78b05f-8a1c-4dd0-8096-cb8e470feec6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.012215 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 284/565] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.013448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b199a-d845-488b-b7dd-6300b746052a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.013740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b199a-d845-488b-b7dd-6300b746052a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.014047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b199a-d845-488b-b7dd-6300b746052a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.015387 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 285/566] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:13.015928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b199a-d845-488b-b7dd-6300b746052a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.018955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de880e-2b52-4988-91e0-ca1146aad2d6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.055590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.056190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.056475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.056753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.057412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.057709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.059106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.070492 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 282/567] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.071271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.086472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.089078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.119325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b199a-d845-488b-b7dd-6300b746052a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.153325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.153888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.154175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.154451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.155107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.155415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.156782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.165497 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 286/568] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.166302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.173748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529d18c-ee19-48b3-bbcb-6854a4b5a633 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.207785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.208384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.208667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.208941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.209631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.209965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.211342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765b3ee-1595-4b80-a874-fd03c8403c13 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.218973 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 283/569] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.220094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.220375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.220655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.238359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:13.239553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:13.265168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949bbcd-5a97-4abd-88e3-6a1be134d7a0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.293252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.298888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.303545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.303545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.303545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.305672 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 284/570] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:13.306846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.315869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.317421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.317543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:13.332925 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:13.334104 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:13.335136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:13.335136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.335136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:13.335136 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 287/571] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:13.335136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.411975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea09aa-2db5-4430-9695-a26e0e79303a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.435122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17597bfa-fd93-432a-a3a6-868b786970f1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.444759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.445380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.445663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.445964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.452531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.453999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:13.465590 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:13.466647 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 285/572] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:13.467533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.473084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.473711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.474031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.474308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.485062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.486537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:13.500220 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:13.501407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:13.503224 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:13.503224 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.503224 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:13.503224 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 288/573] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:13.503224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.536021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.536379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.568183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bd47e-569c-4ec1-81d1-dcf90bb91b2c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.601084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ea0b-4f01-4579-9f57-24cb9dd60e32 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.602010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.602877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.603855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.603855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.614076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.615519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:13.630191 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:13.631192 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:13.632044 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:13.632044 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:13.632044 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:13.632044 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 286/574] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:13.632044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.639164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.639794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.640076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.640352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.650929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:13.655572 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:13.656498 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:13.657314 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 289/575] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:13.658044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.734392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f46fde-6796-4b77-937d-295135a41185 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.749248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.753587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.755975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98830266-8543-4fe9-be5b-32497ab3458f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.767032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.767626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.768527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.768909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.769684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.770026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.771399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.782649 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 287/576] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.783547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.789221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.789921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.790551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.790979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.791995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.792300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.793714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.805581 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 290/577] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.806391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.892102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe7d46-4d7c-4237-8de4-8a9e2fb74047 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.904075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416db0d1-43b2-49ea-9567-7211a4c7d048 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:13.926173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.926774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.927058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.927335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.927979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.928286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.929687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.936579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:13.937166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:13.937444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:13.937719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:13.938373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:13.938675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:13.940388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:13.940963 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 288/578] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.941772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.952789 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 291/579] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:13.953471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:13.969599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:13.989975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.046542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef04cf-27be-439e-81e1-cfc27d5147ea None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.054511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f1623-4136-46fa-a355-880ddb555951 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.080111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.080706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.081268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.081519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.082209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.082515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.083882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.087642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.088256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.088537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.088849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.091518 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 289/580] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.092290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.095231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.096697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:14.107420 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:14.108474 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 292/581] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:14.109574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.181586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.194952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7954a7-29d6-4f2f-b2b8-9c7f0a581b3a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.196440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.205247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b628a-ed67-40fe-a2ac-637b537835f3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.228527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.229141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.229406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.229682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.230455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=9deb5a597756481c89061d48e6632961) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.230763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.232179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.248316 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 290/582] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/role_assignments?user.id=9deb5a597756481c89061d48e6632961&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.248316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.248585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.248585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.248585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.248585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.249088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.249088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:14.262132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:14.263147 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:14.264099 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:14.268707 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 293/583] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:14.269676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.368170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433c64b-33cd-4c48-ba3f-741fd5b4d986 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.385357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2669-3704-48cc-9750-6e04612a5257 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.414737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.415369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.415652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.415931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.423368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.423539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.424026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.425256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.425535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.425699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.428023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.437154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:14.437755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:14.438755 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:14.439791 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:14.440607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.443665 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 291/584] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:14.444428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:14.453926 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:14.454929 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:14.463129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:14.463129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:14.463129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:14.463129 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 294/585] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:14.463129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.481591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.555546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70f9a-fe67-4074-9c0f-488dc3437ed6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.567409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9445-c4de-4272-bb24-fdc066dfe1e4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.594109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.594862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.595440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.595727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.597277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.597585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.599759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.603219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.603822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.604103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.604378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.605099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.605407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.606873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.620397 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 292/586] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.620397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.633865 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 295/587] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.633865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.681597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.728300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.740699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6251e-96c2-4ced-a0d9-3c9cb52ae012 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.740851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1848-6bb6-4c83-b214-bbc32dedba84 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.776944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.777153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.777542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.777644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.777818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.777971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.778124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.778215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.778743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.778845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:14.779045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.779139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.780409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.780515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.797692 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 296/588] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.797692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.802875 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 293/589] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:14.806030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:14.905347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e8f3-38bd-4df1-830c-91988c685b78 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.910432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.913361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db782255-8a89-4d47-a9b6-36c6eee82b87 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:14.943250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.943911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.944193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.944469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.949715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585a942-e706-4924-b249-c83febea7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:14.950384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a942-e706-4924-b249-c83febea7579 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:14.950668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a942-e706-4924-b249-c83febea7579 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:14.950933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a942-e706-4924-b249-c83febea7579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:14.959012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=f7e1030a5d0842f4b949a37a42ff753d, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.960474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.962392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585a942-e706-4924-b249-c83febea7579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:14.964023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585a942-e706-4924-b249-c83febea7579 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:14.966629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-1585a942-e706-4924-b249-c83febea7579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:14.979568 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:14.980735 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:14.981817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:14.981817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:14.981817 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:14.985218 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 294/590] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:14.986060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585a942-e706-4924-b249-c83febea7579 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.050143 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 297/591] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:14 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:15.051177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.110597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585a942-e706-4924-b249-c83febea7579 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.162323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.163250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.164398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.164826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.177604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.179349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:15.195820 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:15.197049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:15.198302 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:15.203740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3952c-1d00-41ee-9ccf-82a62001e6c7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.204582 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 295/592] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:15.205731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.251220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.251460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.251816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.252884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.264052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.265629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.271241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:15.283973 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:15.285093 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:15.286209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:15.286209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:15.286209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:15.289983 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 298/593] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:15.290973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.306639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.324590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db6d6-4879-4ea3-a8e4-88cb9ce31624 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.369190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.370040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.370432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.370803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.371555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:15.371976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.374070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.389212 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 296/594] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:15.394757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.431340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289dbb4-b8a9-4930-97ec-a4fe14225e85 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.478425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.479282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.479874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.480327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.482061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:15.482545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.484141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.501697 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 299/595] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:15.507068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.512524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1b48-18c6-4271-b6b6-437aeef15ebb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.530427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.550086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.550862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.551193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.552087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.552489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:15.552920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.554604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.571663 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 297/596] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:15.571663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.606483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.626462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d3e43-64d0-4c03-83c7-5783f8bf72f5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.661088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.661894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.662271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.662639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.669655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.671292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:15.682680 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:15.684209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:15.685325 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:15.691453 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 300/597] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:15.692419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.694239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c99855-5bc4-459a-b73a-c62ff3dc7852 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.730910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.731786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.732216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.732665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.745017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.747283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:15.763059 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:15.764089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:15.765056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:15.765056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:15.765056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:15.767349 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 298/598] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:15.768528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.797799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9903-a6b2-43af-b845-958d80e08309 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.800733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.823346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.834954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.835790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.836070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.836349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.844961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.847834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:15.866685 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:15.867606 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:15.868489 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:15.871140 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 301/599] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:15.872072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:15.888166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2788-6df7-47bb-a868-266dcd7d5447 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:15.926754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c396-848e-41f8-83b5-95068934350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:15.927497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c396-848e-41f8-83b5-95068934350a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.927923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c396-848e-41f8-83b5-95068934350a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.928431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c396-848e-41f8-83b5-95068934350a None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.929275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c396-848e-41f8-83b5-95068934350a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:15.929657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c396-848e-41f8-83b5-95068934350a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:15.931448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c396-848e-41f8-83b5-95068934350a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:15.949903 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 299/600] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:15.949903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c396-848e-41f8-83b5-95068934350a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.010249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106120-8518-4e6e-ad7e-cbfc3cc6f279 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.047153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.060309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c396-848e-41f8-83b5-95068934350a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.060618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.061501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.062184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.063462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.064311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:16.064868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.066463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.079822 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 302/601] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:16.081780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.098392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.099006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.099287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.099582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.100792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:16.101221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.102853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.118630 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 300/602] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:16.119542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.134052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.197151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465d70-5df3-4559-985c-d1b9b3d8c11c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.232596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.233261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.233546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.233825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/c6ee4ba08ab84302b567df30df796e5c/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.249982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=c6ee4ba08ab84302b567df30df796e5c, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.251445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647920ee-a5eb-4305-be21-6d7b1d9634b9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.255880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35908-bf4f-4f4e-8cfa-a3fe86c6a896 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.294946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.295582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.295866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.296140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.303157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.304675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:16.315880 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:16.316752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:16.317645 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 301/603] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:16.318609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.329491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.338118 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 303/604] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:16 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/c6ee4ba08ab84302b567df30df796e5c/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:16.339635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3ad2-161f-4c4a-9522-7b1ca75be4ee None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.339922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3ad2-161f-4c4a-9522-7b1ca75be4ee None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.340194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3ad2-161f-4c4a-9522-7b1ca75be4ee None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.341650 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 304/605] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:16.345161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc3ad2-161f-4c4a-9522-7b1ca75be4ee None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.448306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef6c5d-43fa-405d-a776-28e7a1531774 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.458722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.466646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc3ad2-161f-4c4a-9522-7b1ca75be4ee None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.492583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.493653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.494195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.494672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/37ad903b3fcf4e1f90c6c8d2c716d3f1/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.505244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.505864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.506160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.506436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.507131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:16.507462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.508952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced487-354c-4cf0-8a96-6152a3dde65f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.513769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=37ad903b3fcf4e1f90c6c8d2c716d3f1, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.515427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.524670 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 305/606] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:16.527405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.527405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.527405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.545889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:16.548231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:16.610439 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 302/607] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:16 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/37ad903b3fcf4e1f90c6c8d2c716d3f1/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:16.618334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.645259 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 306/608] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:16.680313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.731806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.809208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03ce9c-2586-4c66-b130-4c035c0b17a9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.854807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.855208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.856364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.856560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.856982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/5e19c7f04deb4b04b4c2d98ca7323b84/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.876215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=5e19c7f04deb4b04b4c2d98ca7323b84, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:16.878554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:16.880241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88f513-7db0-41d1-a2ba-afd6c7c3c689 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.920774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.921406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.921690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.921990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.933452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:16.938157 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:16.939122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:16.940734 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 307/609] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:16.945262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.957653 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 303/610] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:16 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/5e19c7f04deb4b04b4c2d98ca7323b84/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:17.075641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7c3b1-d82c-405d-986e-687ba72e74a7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.113925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.114522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.114796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.115065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.115735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:17.116091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.117490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf66a14-35a4-4b2d-972d-fcad088670d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.126904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 308/611] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:17.135007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.218674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bccf35-fbcb-4998-a752-53589ee243e1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.219013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bccf35-fbcb-4998-a752-53589ee243e1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.219227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bccf35-fbcb-4998-a752-53589ee243e1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.221236 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 309/612] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:17.226517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.226808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.227783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.246127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:17.253777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:17.255080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:17.274141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908613d4-268c-4f66-a3af-b55cbda19cc3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.293857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:17.337103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.337659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.338005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.338328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.360019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.362161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:17.378405 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:17.379370 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:17.380233 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:17.380233 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:17.380233 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:17.380233 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 304/613] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:17.385856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.403611 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 310/614] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:17.438174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.531110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6517263-c365-4a73-af67-cd1bffcfaa46 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.598267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.598947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.599235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.599509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.600170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:17.600479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.601879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.618272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad86f6-981e-4367-adcd-4e353c4ae386 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.632050 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 305/615] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:17.639035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.670349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.670983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.671265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.671537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.679622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:17.680257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:17.695005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:17.699750 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:17.700662 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:17.701587 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:17.706194 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 311/616] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:17.713431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.821886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170afe6c-ac41-4a9a-b36f-4e23daec6342 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.882944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023388-d79d-43d2-9551-ec17b30f329a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:17.886130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.886763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.887047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.887320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.899357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.900805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:17.920001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:17.921934 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:17.924240 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 306/617] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:17.930952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:17.950959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:17.951573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:17.951860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:17.952140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:17.952874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:17.953188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.954619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.971326 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 312/618] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:17.983905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.090377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.098200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.140116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd980868-59e1-4584-89d2-7e215075bcc7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.149811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd82027-f48d-4a61-92dc-4e5823e260cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.202226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.203142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.204444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.205433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.229002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.229386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.230275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.231904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.232346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.232778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.233664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:18.234586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.238282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:18.263126 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:18.264358 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:18.265476 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:18.265476 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:18.265476 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:18.266117 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 307/619] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:18.266810 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 313/620] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:18.272606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.273818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.403152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae408ff5-886a-4261-96d5-697d97b3593b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.425570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.439524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a2f1e-9c79-4374-9c24-0264f658ae8b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.473232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.474063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.474545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.474829 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.475483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:18.475917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.477370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.482138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.483035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.483517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.483993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.492225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.500937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.500937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.512134 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 314/621] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:18.516804 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:18.518271 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:18.519145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:18.519145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:18.519145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:18.519323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.519396 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 308/622] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:18.524002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.668819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bdb22-fa3f-40f7-b69a-c7e006407a95 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.687968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555480c-626b-47bf-ba4c-5c7568089683 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.705299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.706264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.706541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.706917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.707563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:18.707869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.709246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffc54-03d7-405c-805b-c19934785628 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.723269 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 309/623] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:18.724658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45874-116d-4803-a9b6-2fb348ed4dd8 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.724944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45874-116d-4803-a9b6-2fb348ed4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.725060 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.725243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45874-116d-4803-a9b6-2fb348ed4dd8 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.725804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.726179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.726524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.726708 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 310/624] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:18.728483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45874-116d-4803-a9b6-2fb348ed4dd8 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.739407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.741014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7ac1e2d6-ae90-4adf-89e9-14cf8a73888c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:18.754689 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:18.755715 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:18.756668 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 315/625] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:18.757741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.757923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.762358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.777084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:18.778335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:18.784371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.805663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:18.839229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45874-116d-4803-a9b6-2fb348ed4dd8 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:18.851892 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 316/626] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:18.859017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.877513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:18.878244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:18.878535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:18.878928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:18.890330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:18.898428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:18.913652 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:18.914840 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 311/627] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:18.916134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:18.991101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b23eb-818c-4e01-a3f1-0afcfac161e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.028160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1cc6-9b2a-4c9d-b017-5c058bc1a9a5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.029243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.030158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.030680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.031102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.032003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:19.032472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.034647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.040627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.054535 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:19.059969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.065756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.066612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.067346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.067466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.075945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.082125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:19.087184 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:19.094816 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 312/629] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:19.096245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.168928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e772e-e32f-40eb-83cb-79feb3d55a0c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.209869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576ec57-6387-41a2-ab61-1d86188c9a53 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.210985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.211599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.211878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.212150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.213264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:19.213577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.215478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.231894 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:19.232563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.246416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.247322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.247804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.248277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.290656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.319303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.320584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.322270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d6848-0acd-40c0-a96f-0fc8b4f87ceb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.342201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce325-ceee-4b81-9bdb-90afaaea4d50 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.377983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.378580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.378859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.379133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.379794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:19.380096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.381485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f455-b4e5-463a-9b84-9438bcf5e582 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.389103 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 319/631] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:19.390268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148a9c-0054-443f-b2ad-d2013c8778bd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.390551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148a9c-0054-443f-b2ad-d2013c8778bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.390823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148a9c-0054-443f-b2ad-d2013c8778bd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.392168 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 320/632] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:19.393255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148a9c-0054-443f-b2ad-d2013c8778bd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.428378 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 313/633] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:19.429479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832ac5-f8ca-49f4-b559-186772297188 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.429764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832ac5-f8ca-49f4-b559-186772297188 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.430069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832ac5-f8ca-49f4-b559-186772297188 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.433907 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 314/634] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:19.433907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832ac5-f8ca-49f4-b559-186772297188 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.494101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148a9c-0054-443f-b2ad-d2013c8778bd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.502776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.526687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.527404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.527685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.527957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/9deb5a597756481c89061d48e6632961/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.533504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832ac5-f8ca-49f4-b559-186772297188 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.539565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.543358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=9deb5a597756481c89061d48e6632961, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.544812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.567454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.568069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.568347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.568617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.578282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.579702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-24ce0daf-1e2a-4619-bbd0-e84c5bfbb7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:19.594438 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:19.595583 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:19.596498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:19.596498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:19.596498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:19.596498 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 315/635] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:19.596719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29393b-16db-46be-8529-4028fd76e3b5 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.596982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29393b-16db-46be-8529-4028fd76e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.597139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29393b-16db-46be-8529-4028fd76e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.613579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3b29393b-16db-46be-8529-4028fd76e3b5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:19.614776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3b29393b-16db-46be-8529-4028fd76e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:19.628098 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 321/636] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:19 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/9deb5a597756481c89061d48e6632961/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:19.629089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.695138 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 316/637] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:19.699324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.699962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.701132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.730154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:19.732384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:19.760410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf19dd9-421e-4c2e-9d00-3b0e07a0caf2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.790296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.805455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.806472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.806959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.807230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.817853 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 317/638] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:19.817853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.822214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.823757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:19.839203 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:19.840188 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:19.841636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:19.841636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:19.841636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:19.841636 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 322/639] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:19.841636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.889942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:19.925809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63611f9-bc6d-49e1-835b-bccbd9d9f9d9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.951449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcfc2f-5545-4570-a23e-00b7be8b30f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:19.963339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.963977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.964220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.964525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:19.965288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:19.965608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:19.966995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:19.983629 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 318/640] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:19.983629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:19.998439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:19.999186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:19.999472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:19.999743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.010392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:20.015514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.016456 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 323/641] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.017300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.036509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.099268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455faea-9982-4b4e-a15d-3e6cf8bab40d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.132010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73025e-b4b0-4176-86e2-0479f71cf43a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.133701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.135297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.135970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.136216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.136496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.149276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:20.159043 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.160752 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 319/642] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.161701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.177572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.178123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.178431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.178898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.179597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:20.179993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.181921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.196636 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:20.197374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.277730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f747dd-9cdf-4e99-923a-23cc7950c522 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.279500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.302133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a835a-7d3a-4e23-bcc4-5f3cbddae20a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.311080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.311709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.311995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.312272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.320725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.322280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:20.334700 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.335691 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.341619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.343308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.343920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.344216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.344583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.345247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:20.346089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.347460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.360222 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:20.360222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.382455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.452055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950217ed-e33f-49dc-85e5-1ed6fdadae2c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.463032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e54db6-fec7-4b6d-a757-ed7db22529b7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.488814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.489568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.489863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.490457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.491378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:20.491684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.493656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.497459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.498106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.498390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.498667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.507508 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:20.507508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.507753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.508250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:20.520150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.521256 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:20.522707 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:20.526325 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.527065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.536280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.614770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.617115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e045-a1ed-4729-8bbe-851fba86ea81 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.631519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fab8-b58d-4ce7-b7ce-a1a994f514cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.651665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.652271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.652553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.652829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.653558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:20.653890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.655345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.665694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.666581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.667073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.667505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.676604 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 322/648] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:20.677618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.683859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.685318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:20.700342 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.701347 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:20.702292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:20.702292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:20.702292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:20.703187 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 327/649] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.703796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.771884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.791160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376b6e-884f-4e1a-946b-bc39453e3c0a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.810389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437797ba-c13a-4e20-90fe-bd7c96bac960 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.832631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.833262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.833551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.833822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.843829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.845277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.846705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.847322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.847617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.847869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.848551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:20.848852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:20.850349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:20.853586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:20.860824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:20.862011 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:20.862895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:20.862895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:20.862895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:20.862895 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 323/650] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:20.862895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.869017 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 328/651] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:20.870124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.977124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2ad3-5319-42c2-af1a-91e840869269 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.983069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736655d-4fa6-47bb-a367-d3f081d8734c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.013282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.013922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.014178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.014450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.015083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.015412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.016793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.021655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.022536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.023148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.023524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.026340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.032171 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 329/652] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.032171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.091332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.101950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.103724 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.136162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fbb32-79eb-4edb-91c1-160353de05ae None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.171712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.172319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.172600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.172873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.173532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.173893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.175259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.191728 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 330/653] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.191728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.213070 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 324/654] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:21.218360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.253417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.294126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9447f-70cd-4332-a10d-afb8cacb3674 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.310966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.324497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a18d0-6fe8-4b6e-869d-5ec758804b7a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.328880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.329486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.330287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.330731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.331809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.332215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.333590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.346429 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 331/655] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.347689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.364921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.365571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.365880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.366166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.375301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.376842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:21.390795 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:21.391845 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:59:21.393049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:21.396836 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 325/656] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:21.397904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.493120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b503-488d-4c7c-9ea6-1949ed4e7505 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.523134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.530184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c9e2-225c-4214-ac84-156e48e9b9b2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.536699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.538202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.538202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.538202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.551165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.552634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:21.567173 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:21.568177 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 332/657] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:21.569733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.587605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.589076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.589812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.590134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.605074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.606708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.621643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:21.623632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:21.624528 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:21.626086 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:21.626086 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:21.626086 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:21.626086 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 326/658] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:21.626376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.693203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f38e-e276-49b9-b6b6-c9c20b202d15 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.727640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.728251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.728515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.728788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.729512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.729815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.731322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.739705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f701aa-84b1-431a-939e-36d2afb68235 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.748693 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 333/659] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.750558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.782415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.783741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.784117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.784485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.785304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.785721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.787259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef130c4-6049-4d98-a7f8-a45ef16fd5b2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 327/660] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75897-2bfc-4c24-b5fc-1b60842a7aa7 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75897-2bfc-4c24-b5fc-1b60842a7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75897-2bfc-4c24-b5fc-1b60842a7aa7 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 328/661] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:21.809508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75897-2bfc-4c24-b5fc-1b60842a7aa7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.816086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.856473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.860140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c25c-a2e5-47d8-be53-56062257e3de None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.897072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.897789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.898135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.898517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:21.899159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:21.899465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.900836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.913252 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 334/662] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:21.918035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:21.922486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75897-2bfc-4c24-b5fc-1b60842a7aa7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:21.961819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:21.962451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:21.963030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:21.963030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.031944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313340-95cb-4401-8709-c7ee10d7eb20 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.035224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.036702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768762-de17-4c1f-aee5-c259c95b2290 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.040436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.067441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.068053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.068336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.068613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.098588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.141127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.143065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.151115 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 329/663] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:22.151115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.151115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.151115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.167293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:22.168731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:22.240557 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 330/664] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:22.246661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.258007 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 335/665] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:22.259003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.290406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.319678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.360760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66190-14fb-4681-8093-a4bed20413f1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.363279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27597842-5946-40ac-b586-fcedc70f6b13 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.397288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.397860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.398140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.398508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.398804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.399425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.399708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.399983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.405591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.407164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.410419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.411843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:22.418808 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:22.419689 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:22.420556 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 331/666] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:22.421045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:22.430784 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:22.431754 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:22.432669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:22.432669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:22.432669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:22.432669 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 336/667] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:22.432669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.524386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.533574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4bae5-de46-4543-b6d9-6a0b775e6b7c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.536270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0255-952e-47f9-976d-359faa849249 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.547622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.573310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.573884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.574037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.574233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.574505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.574613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.574786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.575062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.586224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.586712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:22.587866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:22.591875 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:22.592855 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:22.593699 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 337/668] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:22.594893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:22.609181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:22.610428 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:22.611607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:22.611607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:22.611607 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:22.611607 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 332/669] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:22.611842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.711865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf9f2b-40eb-460b-9d10-180326481822 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.724672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aafbd-00b5-4251-91ea-cbd9a8b5f8c2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.745176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.745929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.746320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.746717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.747508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:22.747914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.749429 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.761487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.766756 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 338/670] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:22.766892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.766892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.766892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.767145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.767299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:22.767299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.767299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.784931 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 333/671] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:22.784931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:22.793579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.803633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:22.876662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09753b74-aec1-478e-8da6-0f78321c5e75 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:22.913855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:22.914680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:22.915057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:22.915440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:22.916263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:22.916761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:22.918296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:22.933003 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 339/672] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:22.933003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.020309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2746fe-6b63-4c3f-a1d8-7fb66746cab7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.029734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.039248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480a29-1f65-47ed-9499-a3dcea8c2315 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.055810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.056412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.056687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.056961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.057594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.057922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.059284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.072195 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 334/673] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.072998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.079542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.081048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.081455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.081894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.083256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=c6ee4ba08ab84302b567df30df796e5c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.083708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.085639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.101903 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 340/674] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:22 2022] GET /identity/v3/role_assignments?user.id=c6ee4ba08ab84302b567df30df796e5c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.101903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.160337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.210958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b71b-a2cf-4a7e-a549-00e7b8be306c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.243383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb07f8-153b-4d9e-b23b-5cb2db84a993 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.266796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.268842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.269552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.270000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.281324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.282880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.291357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.291984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.292263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.292535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:23.297092 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:23.298025 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:23.299085 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:23.301881 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 335/675] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:23.301881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.307516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.309204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:23.327522 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:23.328560 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:23.329432 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:23.329432 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:23.329432 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:23.329432 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 341/676] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:23.329432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.342175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.420008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bd1a-2ed0-46d1-8522-7b5e610abc2e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.441672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72112d40-d061-41c5-aaa6-e92f5aec2f63 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.448666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.459269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.460222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.460789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.461259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.468712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.470654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.478934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.479540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.479822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.480105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.480793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.481097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.482564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:23.485048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:23.485971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:23.486847 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:23.489172 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 336/677] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:23.490180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.504045 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 342/678] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.505059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.593632 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.606930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ade433-29a4-4e85-b691-f74866e7c79a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.628577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461da36-4e8e-4a92-9663-9a96cdf53527 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.644465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.645072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.645374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.645655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.646322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.646633 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.648000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.664608 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 337/679] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.664608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.675380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.676061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.676346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.676623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.677317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.677631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.679094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9149f7-8a4f-44c2-872a-8a85a085ebef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.696521 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 343/680] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.696521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcbfe6-d378-4529-88f6-fd63add23c65 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.696521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcbfe6-d378-4529-88f6-fd63add23c65 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.696521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcbfe6-d378-4529-88f6-fd63add23c65 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.697155 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 344/681] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:23.697868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcbfe6-d378-4529-88f6-fd63add23c65 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.726317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.781023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3606-8685-479c-b565-11b2447babb2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.812929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcbfe6-d378-4529-88f6-fd63add23c65 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.818964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.819823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.820306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.820800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.821587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=37ad903b3fcf4e1f90c6c8d2c716d3f1) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:23.821983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.823387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.829513 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 338/682] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/role_assignments?user.id=37ad903b3fcf4e1f90c6c8d2c716d3f1&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:23.830458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:23.862565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:23.874725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:23.875677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.876118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.878494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.888822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:23.890977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7f51b65b-025e-4542-8fa8-63bf882b6aee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:23.910136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:23.911225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:23.912162 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:23.915450 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 345/683] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:23.916954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:23.917390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:23.917792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:23.943195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:23.944730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:23.963776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960936f-036b-4acb-b6b1-057fe77f0dee None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:23.980850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.017245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.017885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.018167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.018436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.019161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=5e19c7f04deb4b04b4c2d98ca7323b84) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:24.019466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.020876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.029741 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 339/684] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:23 2022] GET /identity/v3/role_assignments?user.id=5e19c7f04deb4b04b4c2d98ca7323b84&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:24.030961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.036155 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 346/685] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:24.062240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.144663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b958-1909-4f7a-b33d-8fb6c2915f72 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.181405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.182148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.182430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.182708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.183449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:24.183872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.185386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.190493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57e4c-f7c3-4a33-9443-9e88153b9557 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.209916 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 340/686] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:24.210477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.211845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.231712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.232559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.232935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.233277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.245154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.252412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:24.257368 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:24.262940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:24.263959 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 347/687] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:24.265865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.342510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d9de6-f6f6-421c-b99b-6966ebc026f6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.381353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.381985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.382264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.382542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.410307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c725b-4ad7-45f2-9eac-b37083db1805 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.452248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.452812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.453096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.453369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.455377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:24.455694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.457548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.462348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.464756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.466321 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 348/688] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:24.472571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.503153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.522280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.583671 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 341/689] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:59:24.590846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.607158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865923f4-c257-4098-a195-d21f6fa95121 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.686543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.687559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.688038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.688529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.702327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c786d7-1726-42ef-89b2-21b22be132ef None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.711910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.713655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.733682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:24.741856 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:24.746327 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:24.747403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:24.747403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:24.747403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:24.747403 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 349/690] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:24.747637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.747637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.747637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.747637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.747906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.769290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.770776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:24.799936 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:24.801130 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:24.802351 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:24.802351 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:24.802351 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:24.802351 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 342/691] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:24.807735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:24.864731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.885634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164dd6-f43c-4035-aae4-77b3265872ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:24.925330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:24.926202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.926651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.927158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.927947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:24.928400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:24.929919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:24.943948 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 350/692] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:24.951387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.005144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9de5-2654-472e-85a3-91e21d8539d6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.069018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.069893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.070349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.070777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.071565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:25.072050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.074817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.100854 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 343/693] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:25.107217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.159966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acdf40-a579-47ff-968f-829421f4a815 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.194686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.226151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.226782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.227067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.227344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.239109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.240570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:25.263225 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:25.264413 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:25.265706 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 351/694] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:25.271472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.299200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.304310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a1941-c853-4637-9b19-17886fee6113 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.390656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.391311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.391593 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.391866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.415093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.416490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.417046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85bd77-7773-471b-97ef-ffd240219956 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0e3936a7-1f4c-4f9d-9570-4ccb11003b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:25.437656 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:25.438616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:25.440663 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 344/695] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:25.441421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a738-ea48-4089-9c54-b82eb8353187 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.441421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a738-ea48-4089-9c54-b82eb8353187 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.441421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a738-ea48-4089-9c54-b82eb8353187 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.443586 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 345/696] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:25.446267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918a738-ea48-4089-9c54-b82eb8353187 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.463308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.463920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.464201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.464478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.465777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:25.466137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.468061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35212e52-b979-43a9-a0a1-5d21bf8cf198 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.491290 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 352/697] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:25.492791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.493133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.493414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.514494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:25.515687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:25.568795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918a738-ea48-4089-9c54-b82eb8353187 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.571484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.587710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.592831 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 353/698] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:25.593933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.610111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.611290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.612132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.612442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.613166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:25.613540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.615149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.628743 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 346/699] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:25.629636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.704169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2963-c666-4bcd-b6c7-fe0ef3c873dc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.743993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.744407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbea7-0c5f-4ad6-b3a2-6266e79024bd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.745153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.745632 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.746209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.781011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.781636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.782002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.782278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] PATH_INFO: `/v3/services/network` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.783580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.785311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:25.796758 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:25.797814 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:25.798888 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 347/700] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:25.799658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.825948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.828477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.831080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.831923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.908293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e5e20-5573-4564-8829-ed544aad4587 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.941064 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 354/701] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:25.942327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.945362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:25.946600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.946600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.946600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.947481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=9deb5a597756481c89061d48e6632961) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:25.947794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:25.949225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:25.962086 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 348/702] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/role_assignments?user.id=9deb5a597756481c89061d48e6632961&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:25.963085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.112303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.116713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9ca8-318f-448b-aa2f-c0eeef1b80ff None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.151045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053346b-740d-45d6-a743-1e0dad5ddc56 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.176164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.196847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.198371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.198861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.199804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.200852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] RBAC: Adding query filter params (name=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:26.201409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.204488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.210817 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 355/703] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:26.216070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.230899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.231543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.231820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.232204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.246235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.247686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:26.263481 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:26.264498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:26.265399 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:26.265399 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:26.265399 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:26.269412 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 349/704] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:26.271034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.336486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2e8e3-fea9-45d3-ae15-d807c527f0be None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.382548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.383826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.384500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.384927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.385781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:26.386275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.386489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57431f4-2d03-48d3-9c48-576eaa97b62e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.387972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ee9e-534a-47ce-b95b-c30a11d27338 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.395673 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 356/705] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:26.397030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb67b-57e1-4e9b-a25e-0f345c6ae78c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.397030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb67b-57e1-4e9b-a25e-0f345c6ae78c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.397291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb67b-57e1-4e9b-a25e-0f345c6ae78c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.398837 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 357/706] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:26.404444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c631-1f62-4791-a727-726dd23abec8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.404731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c631-1f62-4791-a727-726dd23abec8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.405009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c631-1f62-4791-a727-726dd23abec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.437030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.438019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.438480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.438997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.439908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:26.440409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.442103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.461984 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 350/707] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:26.463904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.468678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.558985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4a74c631-1f62-4791-a727-726dd23abec8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:26.560197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4a74c631-1f62-4791-a727-726dd23abec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:26.605214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.614548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd30a-0d8d-41e7-84b1-8b592033283d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.660172 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 358/708] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:59:26.661775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.662321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ad690-3c29-4837-985b-51e7f677a085 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.662598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ad690-3c29-4837-985b-51e7f677a085 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.662870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ad690-3c29-4837-985b-51e7f677a085 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.663354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.663840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.664302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.664434 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 359/709] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:26.670869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.671157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.671432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.677902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.679761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:26.691998 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:26.692931 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:26.693800 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:26.694282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:26.694282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:26.696486 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 351/710] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:26.700975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.770299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.794293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 360/711] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:26.795580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.812623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee3a7-7b98-48ea-9cd8-cf21561df63a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.858306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.859097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.859379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.859706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.873496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.875031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:26.895215 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:26.896213 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:26.897091 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:26.897091 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:26.897091 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:26.897091 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 352/712] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:26.897738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:26.904571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.920114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c047b5-9a25-410f-b12e-075bdffddeff None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:26.969870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.971133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.971410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.971678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.972368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:26.972670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.974217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.991603 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 361/713] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:26.991603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:27.033858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db51e1-cbd9-43e8-8928-8ed020c150d3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.058350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:27.069463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.070048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.070324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.070597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.071180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.072909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:27.083181 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:27.084316 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:27.085187 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:27.088872 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 353/714] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:27.089735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:27.128626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a663a-bee0-4284-bee9-36fc82781cb5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.172999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.174533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.175214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.176118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.177244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:27.177755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.179846 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.197590 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 362/715] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:27.197590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:27.210785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00761-0487-4262-8ab1-06f71a9112c6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.212283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:27.247024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.247720 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.247940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.248216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.249186 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:27.249307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.250786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.262131 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 354/716] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:27 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:27.263524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:27.320071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae525e-86c6-4047-845d-f02ebe9c1728 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.354893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:27.377880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.378654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.379749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.379749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.380107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:27.380681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.382193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.397175 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 363/717] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:27.408933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:27.419472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb90c-fe9e-46fa-b65b-620f4d186962 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.457113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.458161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.458691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.459162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.460005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.461627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38004c7-40c4-4c59-b061-142285c0a703 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.517727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:27.554751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d1944-d146-4ca6-a219-130673f976fa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:27.559832 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 355/718] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 00:59:27 2022] POST /identity/v3/users => generated 254 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:27.599669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:27.600401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:27.600687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:27.600981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:27.601706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:27.602038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:27.603549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541206d0-274d-4437-b63b-fa7a9cdd3ffa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:27.610009 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 364/719] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:28.542572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb655-68aa-4deb-8b89-d306b0b0bff9 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:28.543122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb655-68aa-4deb-8b89-d306b0b0bff9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:28.543122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb655-68aa-4deb-8b89-d306b0b0bff9 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:28.544686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 356/720] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:28.563562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:28.564196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:28.564392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:28.583301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:28.584544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:28.656684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc164-91e4-42b0-b354-bb6e5ae3e867 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:28.657004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc164-91e4-42b0-b354-bb6e5ae3e867 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:28.657241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc164-91e4-42b0-b354-bb6e5ae3e867 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:28.659518 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 357/721] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:28.664889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:28.665182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:28.665458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:28.667176 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 365/722] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:28.684429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:28.685659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:28.711282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:28.809012 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 358/723] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:28.825441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:28.835701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:28.878595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:28.886533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd1c84-c0e8-464e-88e9-07dcc1b8b85e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:28.956455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:28.957108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:28.957388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:28.957662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:28.977140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:28.982753 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:28.991303 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:28.992132 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 366/724] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:28.999039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:29.002900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef6d96-ed93-4fca-a1bb-dcc2c4e912f4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:29.067439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:29.067974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.068252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.068527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.069172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:29.070584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:29.145593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26476c7a-b234-4f5b-a03c-88b979739c1e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:29.171981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:29.183646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:29.184259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.184629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.184908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.186132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:29.186451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:29.188058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:29.195350 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 359/725] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:28 2022] POST /identity/v3/services => generated 240 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:59:29.198577 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 367/726] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:29.205256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:29.356919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:29.389114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c23a08-ea47-455a-8d2b-ee7fce2791d6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:29.428615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:29.429256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.429536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.429815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.441749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:29.443246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:29.459259 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:29.460224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:29.461198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:29.461198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:29.461198 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:29.461198 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 360/727] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:29.469177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:29.575472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1a111-d967-418c-a2be-6f5d7d6c4bd1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:29.611475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:29.612010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.612335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.612611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.613256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:29.613559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:29.614951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4b945-3c05-456e-a3f6-71dd65a5caa8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:29.628085 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 368/728] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:29.633592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:29.754581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a8b26-b6fc-4382-a603-e21b9773ea4d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:29.795239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:29.796224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.796728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.797197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.805458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:29.807232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:29.809329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e269e77d-f856-414f-8e90-be4806a61dbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:29.820109 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:29.821073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:29.822071 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:29.822590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50de09-8b21-431e-90e3-3cb99d8c0dfa None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.822590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50de09-8b21-431e-90e3-3cb99d8c0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.822590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50de09-8b21-431e-90e3-3cb99d8c0dfa None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.823293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 369/730] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:29.825915 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 361/730] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:29.827104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50de09-8b21-431e-90e3-3cb99d8c0dfa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:29.837232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:29.837232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:29.837232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:29.856463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:29.857655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:29.941931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:29.942106 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 362/731] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:29 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:59:29.973783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.027067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50de09-8b21-431e-90e3-3cb99d8c0dfa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.065916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.066527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.066805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.067077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.067807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:30.068117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.069555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8ec4-6b84-4af9-b574-3ea6c9af833a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.092584 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 370/732] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:30.092584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a7b5-f60e-40ae-9a72-8aadfd6a87b2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.092584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a7b5-f60e-40ae-9a72-8aadfd6a87b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.092584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a7b5-f60e-40ae-9a72-8aadfd6a87b2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.093524 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 371/733] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:30.094378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923a7b5-f60e-40ae-9a72-8aadfd6a87b2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.171975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fb64-1aad-48ea-ab6d-a9c030cf0d90 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.208709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.211808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923a7b5-f60e-40ae-9a72-8aadfd6a87b2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.218162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.219036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.219460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.219900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.222232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.231178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4f1017e2-cfb7-4275-89e0-2888b4deac37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:30.236261 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:30.237426 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:30.238541 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:30.245726 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 363/734] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:30.247796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.248314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.248800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.253631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.254289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.254541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.254883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.270358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:30.271910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.344466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.347207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.357919 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 364/735] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:59:30.359088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.468097 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 372/736] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:30.468993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.476720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.480687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49859dc-4cbb-47ee-95e5-a963b5c6c031 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.499828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.518082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.518662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.518943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.519217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.520013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:30.520317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.521680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244599-eb6d-4d0c-adc3-04758dad8683 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.529992 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 365/737] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:30.531215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861da-2355-4639-80b0-e1bdcb3f4315 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.531500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861da-2355-4639-80b0-e1bdcb3f4315 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.531774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861da-2355-4639-80b0-e1bdcb3f4315 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.533186 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 366/738] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:30.533777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705861da-2355-4639-80b0-e1bdcb3f4315 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.578013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58259551-eb91-40d7-98bf-79cf24d9165e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.613183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.613782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.614089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.614370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.615010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.616384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c7bd-3d7a-4b17-b0fb-525cbd02c58a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.640490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705861da-2355-4639-80b0-e1bdcb3f4315 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.674136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.674756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.675035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.675307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.685056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.686517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:30.700592 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:30.701571 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:30.702502 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:30.702502 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:30.702502 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:30.702502 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 367/739] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:30.702502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.714183 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 373/740] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:30.719122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.720750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.721383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.743661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:30.745428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.746929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.826584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.838833 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc36cf-2e29-4f58-96cf-a718ce610f57 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.849897 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 374/741] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:30.849897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.895323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.896250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.896250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.896485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.908152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.909781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:30.927508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:30.928488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:30.929413 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:30.929413 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:30.929413 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:30.931331 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 368/742] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:30.932326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.975429 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f2b1c-5080-46c7-acb9-e159bbe6cba8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.035345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.056135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211e817-6703-419f-ad6a-f24b0aa4cca5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.066775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.067824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.068330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.068892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.069744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.070284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.071946 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.085473 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 375/743] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.086672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.100076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.100772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.101061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.101340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.113155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:31.118850 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:31.119798 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:31.120622 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:31.125158 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 369/744] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:31.126237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.149699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.203904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7661a-6e20-4cb3-b7ee-67162cabd7f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.236542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cc1b-434b-4cb8-9483-6b84db006378 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.241615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.242329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.242679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.243022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.243732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.244101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.245531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.259433 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 376/745] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.260422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.275960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.276946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.277480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.277975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.285985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.287673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:31.300435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:31.301368 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:31.302278 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:31.309122 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 370/746] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:31.310404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.314560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.373128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9334-376b-417a-91bd-6538b6fd37a8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.386989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.409640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.410525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.410735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.410974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.411704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.412040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.413392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.422604 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 377/747] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.423737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.434559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7bff5-19ad-41d8-befb-a0f31f446b79 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.482414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.483985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.484496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.484970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.496145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.498497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:31.514036 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:31.515080 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:31.515992 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:31.519230 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 371/748] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:31.520251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.549666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2413-8444-4e4f-8edb-97fcd73946a4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.587280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.597695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.601986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.623019 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 378/749] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.624400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.636257 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d5ef-3874-4f37-8afb-0f1d968ee4cc None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.660774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.682019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.682701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.682926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.683208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.693988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.695429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:31.709842 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:31.710794 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:31.711693 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:31.711693 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:31.711693 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:31.711693 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 372/750] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:31.711693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.740412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0a2c-d953-472a-a7e6-16a6bf40008f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.776650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.777115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.777402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.777679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.778425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.778733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.780150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52ae25-5555-484f-9c3a-e1ab97507994 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.798010 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 379/751] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.799185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b2f8-6aa4-4364-bb50-3f99ea77c039 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.799467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b2f8-6aa4-4364-bb50-3f99ea77c039 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.799736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b2f8-6aa4-4364-bb50-3f99ea77c039 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.801063 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 380/752] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:31.805473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7b2f8-6aa4-4364-bb50-3f99ea77c039 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.822657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad06af-f01a-468f-a740-e81774d77c79 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.840753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.865250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.866292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.866579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.866853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.867847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=9deb5a597756481c89061d48e6632961) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.868158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.870382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.885882 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 373/753] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/role_assignments?user.id=9deb5a597756481c89061d48e6632961&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.885882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.908736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.921852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7b2f8-6aa4-4364-bb50-3f99ea77c039 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.969282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.969977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.970258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.970533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.971312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:31.971726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.973247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855dc1a-960c-4578-afd1-2c0935adb621 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.991300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 381/754] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:31.991300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.991300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.991300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.008525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:32.009866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.030113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc4c84-6cdb-46ec-b5cc-506443d002fb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.080993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.081618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.081919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.082194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.093029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.094566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.096679 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 382/755] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:32.097934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:32.123158 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:32.124168 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:32.130383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:32.130383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:32.130383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:32.130383 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 374/756] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:32.133212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.166019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.217092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.238452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e8c4-d06e-4846-9c2e-f0d9b3bd66d9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.240312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037dae-6ba9-46c8-9700-b5a9e940836b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.278729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.279853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.280465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.281148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] PATH_INFO: `/v3/services/network` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.282041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.282928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.283695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.284036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.284374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.285110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.292974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.294566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:32.294964 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:32.296143 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:32.297279 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:32.300005 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 375/757] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:32.301097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:32.322862 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:32.323889 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:32.325263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:32.329903 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 383/758] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:32.331109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.414328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683bb87-03a2-4dd5-9068-e6e8e3530f9e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.418028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.458633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4082a8-e6f6-4f7f-91bd-e59e972c5b98 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.459315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596be438-7895-427a-9087-b903e70d719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.460294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596be438-7895-427a-9087-b903e70d719a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.460646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596be438-7895-427a-9087-b903e70d719a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.461844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596be438-7895-427a-9087-b903e70d719a None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.462516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596be438-7895-427a-9087-b903e70d719a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:32.462873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596be438-7895-427a-9087-b903e70d719a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.464989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596be438-7895-427a-9087-b903e70d719a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.481364 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 376/759] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:32.482232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596be438-7895-427a-9087-b903e70d719a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.501907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.502617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.502904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.503186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.503835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] RBAC: Adding query filter params (name=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:32.504147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.505530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.514302 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 384/760] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:32.515386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.527175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.608812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596be438-7895-427a-9087-b903e70d719a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.639022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489106f7-08c6-4f2a-8739-b903f172a3eb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.647920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.648583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.648870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.649149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.649913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:32.650230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.651666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.671378 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 377/761] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:32.672229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.683152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33471-a779-4529-b302-703f526de079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.683806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33471-a779-4529-b302-703f526de079 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.684095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33471-a779-4529-b302-703f526de079 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.684903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33471-a779-4529-b302-703f526de079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.693158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.697192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd33471-a779-4529-b302-703f526de079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.698840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd33471-a779-4529-b302-703f526de079 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fcd33471-a779-4529-b302-703f526de079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:32.715516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:32.716638 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:32.717658 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:32.725038 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 385/762] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:32.725038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33471-a779-4529-b302-703f526de079 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.800957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eef31-aa82-43ab-b99b-10337e9c637a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.816574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.846853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.847463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.847771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.848079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.848636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:32.848935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.850353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.855827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33471-a779-4529-b302-703f526de079 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.861566 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 378/763] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:32.861566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.898295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.898903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.899183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.899457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.945624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.968229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3b850-f476-40cf-b5e0-6e1112e84ce7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.971186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.972907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.008321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.009101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.009424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.009704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.010462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:33.010777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.012265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a8ae8-4004-4780-a3c3-7ae9444b8840 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.027273 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 379/764] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:33.029416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9f8e-da50-4b42-abd2-28aef161f465 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.029846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9f8e-da50-4b42-abd2-28aef161f465 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.030277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9f8e-da50-4b42-abd2-28aef161f465 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.032814 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 380/765] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:33.033770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9f8e-da50-4b42-abd2-28aef161f465 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.046827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.089870 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 386/766] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:33.089870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.149499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9f8e-da50-4b42-abd2-28aef161f465 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.187342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.187935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.188221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.189039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.189741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] RBAC: Adding query filter params (interface=public, service_id=3516aa188c8447969693aa3ddcb896d1, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:33.190090 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.190900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1fb60-cfbe-4e12-9ee9-a70bfd4def1f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.191461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a063-717d-4ab9-8d82-6e20227eeac4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.203319 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 381/767] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/endpoints?service_id=3516aa188c8447969693aa3ddcb896d1&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:33.203319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.203319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.203319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.208211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.220717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:33.222087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.230962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.231720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.232100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.232482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.234501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=f7e1030a5d0842f4b949a37a42ff753d, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.236259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.289575 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 382/768] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:33.290485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.308031 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 387/769] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:33 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:33.309398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.351299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.414860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945a18-f33a-4803-b4ca-2e269136d1ea None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.452144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6a1b4-0175-4a93-827f-d96d68917c4f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.458412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.465681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.466991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.467406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.467814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.483331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.485948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.498582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.499286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.499635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.499977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.500654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.502682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:33.503856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:33.504971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:33.506580 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:33.506580 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:33.506580 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:33.506580 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 383/770] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:33.506580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.510336 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 388/771] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:33.513576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.669142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c81ab-e7cd-4cda-92ae-a24c8d1cdd5c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.675001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.697699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3455-8d0d-4bbe-8699-95c521494cb4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.741711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.742420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.742757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.743186 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.743913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.746038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:33.758392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:33.759397 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:33.760211 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:33.760939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.760939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.761084 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 384/772] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:33.761150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.761150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.761150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:33.761343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.762785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.771358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.777924 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 389/773] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:33.781744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.841021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.902386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc68d-e576-4f49-8831-12e152661560 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.921131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb15903-6a61-4b49-ad11-8251bcc21a4d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.964893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.966075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.966523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.967231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.968763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:33.969274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.972243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df8ba8-58b0-44ca-850c-94cfa4f0a22f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.976035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.976667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.976951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.977269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.979030 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 385/774] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:33.981651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443052-814c-4cdf-b405-ee06351fe114 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.982104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443052-814c-4cdf-b405-ee06351fe114 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.982507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443052-814c-4cdf-b405-ee06351fe114 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.984395 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 386/775] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:33.984735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.986781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.987025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9443052-814c-4cdf-b405-ee06351fe114 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-99fba02e-6216-40c7-a9d3-459d62a62453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:34.002123 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:34.003197 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:34.004071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:34.006390 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 390/776] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:34.007775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.008246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.008571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.031584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:34.033650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:34.038502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.115500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9443052-814c-4cdf-b405-ee06351fe114 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.117390 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 391/777] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:34.119309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.131243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.159484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.160159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.160447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.160987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.162077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:34.162470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.166690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.175378 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 387/778] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.176610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.249174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643493d8-66cb-4e9a-b61d-f99d2ea15c43 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.293637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.294296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.294580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.294857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.295826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:34.296140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.299024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.309140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a266fc-507b-4be8-b76b-11e0d2a48430 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.310388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.319941 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 392/779] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.319941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.350518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.351154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.351645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.351771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.362850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:34.367969 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:34.368971 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:34.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:34.374203 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 388/780] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:34.375148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.412327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.443713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd0ac-4513-4fa3-bd7e-22db0d2f4d65 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.480092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7c21-e64b-45bb-a7af-ca7053045654 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.481588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.482544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.483032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.483512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.484437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] RBAC: Adding query filter params (interface=public, service_id=2efec44e3c944211a6c24fc46b07e2d7, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:34.484993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.487136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.497857 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 393/781] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/endpoints?service_id=2efec44e3c944211a6c24fc46b07e2d7&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.499294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.515903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.516702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.517001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.517705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.518619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=2a756f12e29a4854be7a4ff1ef0d574c) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:34.518784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.520519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.531298 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 389/782] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/role_assignments?user.id=2a756f12e29a4854be7a4ff1ef0d574c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.531298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.652694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.695910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.709856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445845a-efe3-4b99-b7f0-07b1cb83350f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.753700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355df93-5c92-459d-b345-afe5ec78b253 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.772479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.773794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.774349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.774956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.775795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.777396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.791567 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 390/783] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.809751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.810413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.810695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.810972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.811655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:34.811959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.814070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.830318 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 394/784] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:34.831364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.010474 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264fe1-b73e-4d82-b53f-9694b8b81b99 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.054364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.055010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.055289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.055559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.069120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:35.070651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:35.086928 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:35.087949 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:35.089493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:35.089493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:35.089493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:35.089493 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 391/785] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:35.093579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.217898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e021-6fbe-4bb0-893e-d4cbc6a52e20 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.246370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:35.258660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:35.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:35.262219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:35.276969 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 395/786] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:35.283009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.322318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:35.445297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213647c8-5635-40f8-a3e2-7fd1f429fad9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.492950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.493590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.493888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.494167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.506549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:35.507927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c01302f1-ef8c-4b86-a8b0-1de16476a140 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:35.526455 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:35.527432 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:35.528365 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 392/787] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:35.533773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.681104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0a7e-8ec0-421f-8c8e-212ef8ef82b0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.730000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcf2c-799c-47df-ad05-5e5c81343a13 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.730343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcf2c-799c-47df-ad05-5e5c81343a13 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.730565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffcf2c-799c-47df-ad05-5e5c81343a13 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.731993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.732136 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 393/788] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:35.732930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.733401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.733903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.735624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:35.736151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:35.738013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:35.740052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.740173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.740462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.758293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 396/789] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:35.764293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.783173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:35.786539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:35.838282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:35.889475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e6ede-8019-4a00-ae17-df9041cde99f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.948411 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 394/790] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:35.958134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.958785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.959068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.959346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.970379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:35.971839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:35.984005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:35.989901 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:35.991168 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:35.992244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:35.992244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:35.992244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:35.992244 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 397/791] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:35.994394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.010153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.144075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2862e8-ee8d-4bff-9325-6776512f4501 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.166183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.178061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299131-9346-4e87-b6cd-3f333dab2214 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.194427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.194427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.194427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.194427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.210472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:36.219047 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:36.220955 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:36.222002 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 395/792] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:36.234871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.236951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.237786 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.238310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.238962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.240698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:36.241218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.242847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596917-4f05-4835-82cd-5c9cd08c12e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.257711 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 398/793] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:36.264319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24886c7-6aa5-4b9a-ab11-ce0808ddadd2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.264319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24886c7-6aa5-4b9a-ab11-ce0808ddadd2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.264319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24886c7-6aa5-4b9a-ab11-ce0808ddadd2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.265113 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 399/794] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:36.265659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24886c7-6aa5-4b9a-ab11-ce0808ddadd2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.326510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.365610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e511-2d34-46f8-a7e7-c6ab9a105eb8 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.389813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24886c7-6aa5-4b9a-ab11-ce0808ddadd2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.403817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.404833 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.405363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.405859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.406745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:36.407640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.409299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e31f2-35b5-48f9-9aa6-5c6497a22dba None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.423871 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 396/795] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:36.425562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.426268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.426762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.427344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.427969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.428249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.428523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.435796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.437242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.446876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:36.448332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:36.449939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:36.450785 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:36.451697 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 400/796] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:36.452179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.472419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.529431 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 397/797] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:36.530618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.583629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d222e-f65a-4ba6-8885-0521b3fc4ec9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.593812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.620483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.621108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.621388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.621662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.632994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.634471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.639696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e94d-525c-476b-a750-0aaa764d7f74 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:36.651029 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:36.652048 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:36.652935 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:36.652935 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:36.652935 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:36.657403 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 401/798] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:36.658181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.682001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.682953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.683514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.684095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.684986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:36.685502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.687448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.701074 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 398/799] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:36.707663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.727478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.762281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23699a-4400-4adf-9760-42dc845fd269 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.797069 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.797729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.798452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.798830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] PATH_INFO: `/v3/services/network` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.799724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.801975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:36.814443 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:36.815752 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:59:36.816777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:36.821273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db558a66-f949-4004-bcae-ed11edc1b3d9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.823408 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 402/800] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:36.824254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.841626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.860645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.861705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.862219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.862800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.863706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:36.864248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.865822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.880507 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 399/801] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:36.881702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:36.937821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daecca-082b-4332-91b8-53e61a800640 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:36.972271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:36.980442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:36.980823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:36.981107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:36.981381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/9deb5a597756481c89061d48e6632961/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:36.983525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=9deb5a597756481c89061d48e6632961, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.985163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ebe1-9c4a-4a8e-a803-33ca29c8e658 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.994337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec4573-bc10-4cc0-b358-e1a4deb5b6cf None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.028799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.029395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.029782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.030100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.030726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] RBAC: Adding query filter params (name=network) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:37.031031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.032492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.037071 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 400/802] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:37.037649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.078986 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 403/803] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:36 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/9deb5a597756481c89061d48e6632961/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:37.090531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c747-75ee-4cdf-a7fb-119d1de3f193 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.090960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c747-75ee-4cdf-a7fb-119d1de3f193 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.091117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c747-75ee-4cdf-a7fb-119d1de3f193 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.092000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.092604 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 404/804] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:37.093129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c747-75ee-4cdf-a7fb-119d1de3f193 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.184990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492348-6bd1-4294-9444-67cf14c02dea None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.234763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.235516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.235796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.236068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.245314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c747-75ee-4cdf-a7fb-119d1de3f193 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.247132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.249365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-24c0c114-a83b-44f2-9c68-81f81f308b31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:37.261902 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:37.262897 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:37.263892 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 401/805] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:37.264501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee340-e684-4c06-9ae6-0ad1d5cb3f99 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.264501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee340-e684-4c06-9ae6-0ad1d5cb3f99 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.264818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babee340-e684-4c06-9ae6-0ad1d5cb3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.284847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-babee340-e684-4c06-9ae6-0ad1d5cb3f99 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:37.286064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-babee340-e684-4c06-9ae6-0ad1d5cb3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:37.291724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.292528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.292966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.293497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.294162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:37.294470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.295947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e9f77-2bf8-4f11-acba-9df3109741b5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.307019 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 405/806] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:37.307019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de524e-c793-4f3e-8889-ac2f3a2b6fbc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.307019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de524e-c793-4f3e-8889-ac2f3a2b6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.307019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de524e-c793-4f3e-8889-ac2f3a2b6fbc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.308056 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 406/807] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:37.312222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de524e-c793-4f3e-8889-ac2f3a2b6fbc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.370559 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 402/808] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:37.371818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463378f-facd-420c-8719-03c000821b8c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.372085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463378f-facd-420c-8719-03c000821b8c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.372369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463378f-facd-420c-8719-03c000821b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.393115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5463378f-facd-420c-8719-03c000821b8c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:37.394806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5463378f-facd-420c-8719-03c000821b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:37.398328 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.424478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.432703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de524e-c793-4f3e-8889-ac2f3a2b6fbc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.467161 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 403/809] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:37.467977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463378f-facd-420c-8719-03c000821b8c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.478567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.479494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.480298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.480782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.481607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:37.482062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.483578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.502456 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 407/810] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:37.503498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.588250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463378f-facd-420c-8719-03c000821b8c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.611849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea1dd-418f-458e-94be-bfa5f3eb2e38 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.624412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.625057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.625337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.628658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.629180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.629868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.631245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.647327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.647953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.648232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.648506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.658793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:37.663416 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:37.664524 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:37.665878 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 408/811] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:37.669947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.753737 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 404/812] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:37.755121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.783441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.785649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0c3b-4de0-4818-903a-c3f1145af47b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.837596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.838413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.838777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.839154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:37.840417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:37.842182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:37.855101 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:37.856370 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:59:37.857464 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:37.860595 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 409/813] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:37.860595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:37.886589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb09c-cc45-4a87-abbe-2808b733e781 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:37.911358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:37.925685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:37.926609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:37.927098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:37.927453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.008596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5007f-04e0-4655-9ab4-faa2b2251193 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.040478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.042046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.051986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.052601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.052881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.053152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.053814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:38.054144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.055504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.061528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.064281 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 410/814] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:38.064910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.153002 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 405/815] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:38.154091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.174009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.180172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11156-8366-49d4-a306-5ab9dd55db67 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.218772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.219936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.220211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.220481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.221114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:38.221416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.222903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.233104 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 411/816] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:38.233104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.265695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dc4c-3495-449c-8101-3f281c6d4f69 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.284680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.303209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.304028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.304468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.304744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.315815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.318456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:38.339518 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:38.340670 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:38.341723 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:38.341723 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:38.341723 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:38.341960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e0b1-ccc6-4951-9bb1-e913c4bea03d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.349220 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 406/817] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:38.349220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.379215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.380049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.380501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.380867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.391537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.393084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:38.409407 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:38.410565 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:38.411616 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:38.411616 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:38.411616 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:38.411797 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 412/818] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:38.412616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.428439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.449862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b687050-9e1c-4f28-98ee-095dcbaa72e2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.484842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.486045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.486335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.486612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.487248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:38.487555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.488931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.493981 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 407/819] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:38.498998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.520063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848489fc-e6a4-401d-bacc-f2f9b34e3895 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.536053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.559673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.560363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.560735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.561078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.561722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:38.562054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.563442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.575258 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 413/820] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:38.579270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.606806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322149-47dd-4397-9a9c-23e3fe0e0a58 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.639277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.639877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.640156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.640429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.641609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:38.641944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.643307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.654711 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 408/821] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:38.655509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.665138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.695509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee674bf-2bc1-4897-bd44-859c92f495e3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.730536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.731293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.731675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.732048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.734338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.754275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:38.760710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4d42-f4ec-4603-9f12-fafa17944b48 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:38.794677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:38.795301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:38.795583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:38.795854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:38.802992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:38.804430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:38.816296 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:38.817305 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 409/822] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:38.818527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.834878 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 414/823] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:38.836512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:38.964695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587563f-baef-457b-ad82-385112d169b3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.012276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981bf56-11d7-4e7c-b8c9-bab5eebfb15b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.018370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.019603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.019603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.019603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.029261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.031170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:39.044110 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:39.045008 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:39.045920 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 410/824] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:39.052306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.055415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.066092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.066797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.067260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.067368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.068065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.068374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.069797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.071513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.089714 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 415/825] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:39.095386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.180017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648353b-e3ef-48fb-afe3-05771c9af124 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.215617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a776d-bcdf-4a79-be15-5706a5d7033a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.220562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.221168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.221443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.221716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.222440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.222749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.224182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a92e-8472-412c-a9fe-206ed987ec56 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.241363 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 411/826] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:39.241363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363c93-22a8-414a-a62b-176ab1a857da None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.241363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363c93-22a8-414a-a62b-176ab1a857da None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.241363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363c93-22a8-414a-a62b-176ab1a857da None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.241363 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 412/827] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:39.244346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91363c93-22a8-414a-a62b-176ab1a857da None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.258149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.258776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.259054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.259322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.271812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.273323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1d7b2de1-ac0c-4122-bb89-1c5de8fbbb98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:39.288283 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:39.289268 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:39.290210 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:39.290210 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:39.290210 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:39.294137 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 416/828] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:39.295145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.295445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.295706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.314117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:39.315323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:39.329957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.343893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.364998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91363c93-22a8-414a-a62b-176ab1a857da None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.385649 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 417/829] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:39.386457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.409745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.410416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.410700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.411133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.411760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.412187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.413594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.420062 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 413/830] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:39.420837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.540014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02add466-bde1-406f-91cd-0cb1124bff3b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.541235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a66c-2a2d-48e7-a121-c888c35a1033 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.584458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.585058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.585337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.585611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.593788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.594473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.594794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.595117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.595406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.596075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.597958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.597958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.601534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:39.606923 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:39.608435 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:59:39.609344 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:39.613246 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 418/831] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:39.613645 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 414/832] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:39.616304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.619347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.645612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.730978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c09c-65da-4c02-a3db-e117dfb3f2f1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.741272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c99a-ff46-4ab7-8324-fa6dc760fc41 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.773798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.774791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.775177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.775555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.776491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.777237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.779102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.783051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.783706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.783990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.784265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.792250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.792392 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 419/833] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:39.794007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.798467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:39.810516 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:39.811417 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:39.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:39.815141 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 415/834] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:39.820862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.883938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.898220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.913323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bdb8-515d-47b5-924f-c88076024ca6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.931176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478dcf-21b0-490d-98b2-55e2d96adbc1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.947983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.948542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.948796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.949072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.960609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.962083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.971620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.972903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.973389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.974439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.975367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:39.975904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:39.977575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:39.987238 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:39.992292 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:39.993228 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:39.993228 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:39.993228 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:39.993228 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 420/835] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:39.994441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.001064 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 416/836] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:40.002200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.102228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcf763-134d-4c42-9048-8479ce0f89cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.119362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add985-9373-4d09-ad48-6828cb701a0f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.136448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.137050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.137328 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.137601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.138266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:40.138389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.138565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.139990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.147498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.157191 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 421/837] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:40.158502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.160591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.161335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.161685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.162078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/2a756f12e29a4854be7a4ff1ef0d574c/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.179384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=2a756f12e29a4854be7a4ff1ef0d574c, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.180928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.258168 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 417/838] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:40 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/2a756f12e29a4854be7a4ff1ef0d574c/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:40.260322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81679fe3-b446-42ac-bb8f-37dfbe6dfefd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.299790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a986a-58af-407a-869f-34390064218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.300439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a986a-58af-407a-869f-34390064218f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.300719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a986a-58af-407a-869f-34390064218f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.301042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a986a-58af-407a-869f-34390064218f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.309587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a986a-58af-407a-869f-34390064218f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.311100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a986a-58af-407a-869f-34390064218f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a51a986a-58af-407a-869f-34390064218f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:40.325004 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:40.326954 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:59:40.329613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:40.333992 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 422/839] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 00:59:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:40.334144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.445091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf553-abb3-460a-9e4d-690d210ada5b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.482346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.483185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.483606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.484085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.485759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:40.486310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.487883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.509738 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 418/840] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Aug 7 00:59:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:40.512324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a986a-58af-407a-869f-34390064218f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.574345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.615687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a986a-58af-407a-869f-34390064218f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.651423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.652081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.652361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.652631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.725814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.727331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c7c0-d5e9-4e54-a4a8-659501e21812 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.790928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.835857 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 423/841] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:40.841234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:40.869896 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.947028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b38a0f-f29a-4c80-bf54-21cc34ccfaba None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:40.949949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13e62-a32c-412f-9af3-f62c556d294d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.950762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13e62-a32c-412f-9af3-f62c556d294d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.951197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13e62-a32c-412f-9af3-f62c556d294d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.952955 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 424/842] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:40.959055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.959568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.960040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:40.992855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:40.992855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:40.993045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:40.993045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:40.993045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:40.993045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.002201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.003819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:41.019277 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:41.026255 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:41.027355 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:41.027355 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:41.027355 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:41.027686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 419/843] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:41.029251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.081911 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 425/844] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:41.102167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.120452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.143573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a39c-7786-4acb-ab02-392b6ec1f943 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.178193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.179092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.179540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.179984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.180877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:41.181365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.183057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.200313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.200588 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 420/845] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:41.202047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.212090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f595c-0fcc-4115-9c01-0ba7fe2394b6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.250505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.251247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.251643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.251977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.252813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.254243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:41.263888 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:41.264865 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:41.266059 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:41.270341 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 426/846] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:41.271724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.310680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2b64-04c5-43df-b4af-05f61d160144 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.345824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.346761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.347246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.347712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.354643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.356319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.358272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:41.369467 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:41.377056 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:41.377983 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:41.378843 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 421/847] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:41.380333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.383336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba2ee-6730-4eb4-8cbc-a23a31a1f5cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.421473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.422215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.422502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.422776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.423403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:41.423702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.425068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.434206 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 427/848] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:41.436166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.456624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.496045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987008c-b30f-4ab5-bca0-5c2e84f5ea91 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.534304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.535231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.535801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.536267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.537160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:41.537701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.539568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.548681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fbf2a-008b-4c5a-b78d-670f6a3acec0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.558778 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 422/849] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:41.560378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.586437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.587097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.587375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.587649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.588481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:41.588766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.590271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9c6b9-4f81-4f3d-ac3c-512312787597 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.601936 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 428/850] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:41.629855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.636631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f176-deda-4746-b5d2-13124fba7d79 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.636963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f176-deda-4746-b5d2-13124fba7d79 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.637186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f176-deda-4746-b5d2-13124fba7d79 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.638800 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 429/851] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:41.647663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.648135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.648672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.673493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:41.675491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:41.685503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdb2da-2492-4d16-8843-d82ffc446dea None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.726086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.727064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.727558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.728051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.729024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=9deb5a597756481c89061d48e6632961) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:41.729538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.731231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.745984 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 423/852] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/role_assignments?user.id=9deb5a597756481c89061d48e6632961&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:41.767787 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 430/853] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:41.790749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.905737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c939a-6f11-4935-8a2a-fede43f4c7fa None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:41.931399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:41.942997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:41.943624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:41.943900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:41.944171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:41.944753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:41.949596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:41.955206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:41.956407 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:41.957433 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 424/854] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:41.962500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:41.979951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:42.073260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a239-c266-41a5-a85c-85ced2c1fc84 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:42.110315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:42.110980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.111262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.111538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.112166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:42.112522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:42.113961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936fe-b606-4391-aa4b-0920197d7470 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:42.118780 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 431/855] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:42.124081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:42.231015 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4ad6-e641-46a8-9964-19ddfa331d16 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:42.266428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:42.267387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.267844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.268295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.269103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:42.269596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:42.271156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390838-4608-48ad-a275-689e5a7021c1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:42.281431 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 425/856] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:42.444202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a38a-c0fe-4c34-bfbe-420ef6421101 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.444571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a38a-c0fe-4c34-bfbe-420ef6421101 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.444752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a38a-c0fe-4c34-bfbe-420ef6421101 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.446336 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 432/857] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:42.451716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.452012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.452300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.471800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:42.472997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:42.526285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:42.548439 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 426/858] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:42.572325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4a38a-c0fe-4c34-bfbe-420ef6421101 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:42.652002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:42.678661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4a38a-c0fe-4c34-bfbe-420ef6421101 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:42.713068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:42.713671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.713986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.714261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.725711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:42.730603 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:42.731519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:42.732751 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 433/859] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 00:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:42.738495 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:42.842913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e7d1-ae3c-4206-a059-4c15b7dd421d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:42.882298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:42.883274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.883759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.884254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.885113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:42.885633 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:42.887211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:42.900302 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 427/860] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 00:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:42.902057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.013895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe74dd-6f05-4ed9-baa9-e27bdd135dda None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.053573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.054610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.055092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.055565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.057627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.071419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.072077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:43.087675 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:43.088673 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:43.090021 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:43.090021 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:43.090021 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:43.090021 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 434/861] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:43.096846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.158211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.205886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d57b-3e7d-4ca2-908b-9ff5d38917fa None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.240853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.241778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.242218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.242637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.243471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:43.243920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.245451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.261938 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 428/862] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:43.264361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.371745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5070-67db-4428-9c21-1d383b8fd1f0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.407298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.407963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.408252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.408534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.416654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.418126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:43.430072 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:43.431049 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:43.432613 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 435/863] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:43.439866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.546639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed60a4-45c5-4bd6-872f-6cb63383ecf7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.549231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.582878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.583875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.584359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.584831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.585814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:43.586398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.588077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661020-476c-4333-b1b2-eb3ff837b303 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.612574 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 429/864] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:43.614269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.662824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.670353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02c6a-47f4-4524-b5c8-5fa1410f6f11 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.670639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02c6a-47f4-4524-b5c8-5fa1410f6f11 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.670914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02c6a-47f4-4524-b5c8-5fa1410f6f11 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.672963 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 430/865] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:43.678033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.678322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.678598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.699111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:43.700476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:43.721108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73d88-3013-486f-8254-d59dacde59f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.756659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.757309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.757595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.757895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.802009 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 431/866] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:43.817957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.840105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.841622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.889501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.918239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.925586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0f12-1bbe-4854-907e-0d0f32989f5a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.950077 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 436/867] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:43.958862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.964864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.965711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.966208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.966696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.967645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.969799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6867a2e-b7db-4fbb-9c66-7eb1879e9fce None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.067513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582896-e032-4f85-b312-35a01cced1f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.080812 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 432/868] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:43 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:59:44.082388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6796ae-5487-4dfa-8f1c-410379710447 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.082875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6796ae-5487-4dfa-8f1c-410379710447 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.083433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6796ae-5487-4dfa-8f1c-410379710447 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.089610 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 433/869] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:44.091384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.091879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.092354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.112451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:44.114161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:44.123509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.124153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.124433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.124705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.136980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.138493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.140545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:44.156585 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:44.157612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:44.158940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:44.158940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:44.158940 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:44.163004 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 437/870] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:44.164568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.206280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 434/871] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:44.222892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.287134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2729ca-d22b-4602-aefa-7bb6a9e1d84f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.324365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.327506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.328230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.329142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.329142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.329369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:44.329672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.331413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.345683 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 438/872] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:44.351153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.359227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b6595-5b82-4ff3-a64e-d770e02b2069 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.396276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.396907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.397187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.397523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.398136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.399886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.408556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-3180d419-fbee-4ac4-9e6b-13b0b2986bc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:44.410353 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:44.411315 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:44.412136 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 435/873] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:44.413410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70b9a8-7bea-45af-9dde-b857baa99df9 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.413410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70b9a8-7bea-45af-9dde-b857baa99df9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.413563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70b9a8-7bea-45af-9dde-b857baa99df9 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.418512 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 436/874] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:44.421086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70b9a8-7bea-45af-9dde-b857baa99df9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.456139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d571c-e522-48ae-9ff6-927add414294 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.490544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.491201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.491459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.491733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.498559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.500536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-18a5a286-ea99-4eac-84d0-99fd53c9ba62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:44.513467 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:44.514516 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:44.515404 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 439/875] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:44.516482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.516607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.516785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.532472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70b9a8-7bea-45af-9dde-b857baa99df9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.537338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:44.538552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:44.573162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.574209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.574784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.575289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.576071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:44.576556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.579480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.585211 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 437/876] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:44.586287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.600112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.613951 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 440/877] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:44.614868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.666737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.713627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e16ad-5565-4538-9d5d-34788f311731 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.725203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2fd3c-d670-4cec-8161-8f6ba280df25 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.752221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.752825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.753105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.753377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.754097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:44.754406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.755881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.761478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.762099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.762380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.762650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.763269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:44.763571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.764940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.773101 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 441/878] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:44.773101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.773584 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 438/879] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:44.775082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:44.890287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.891639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf4aa-6d9f-4617-a60a-517d62e7e6fc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.902753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.911442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d61e7-367b-4402-b338-1c798a234467 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:44.932552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.933171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.933447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.933717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.934404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.935782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836c25-0c36-4408-84bd-5be2146ff3a1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.953247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:44.954218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:44.954511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:44.954788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:44.955778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=2a756f12e29a4854be7a4ff1ef0d574c) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:44.956102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:44.957551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84514971-4519-4c6e-ba6e-146ca11d556c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:44.964207 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 439/880] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:44 2022] GET /identity/v3/role_assignments?user.id=2a756f12e29a4854be7a4ff1ef0d574c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:45.036122 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 442/881] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:44 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:46.208078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b15907-cc2f-48fd-86c9-483cc55f0afb None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.209108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b15907-cc2f-48fd-86c9-483cc55f0afb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.209608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b15907-cc2f-48fd-86c9-483cc55f0afb None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.211625 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 440/882] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:46.217777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.218890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.219390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.238199 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:46.239705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:46.320187 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 443/883] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:46.342807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b15907-cc2f-48fd-86c9-483cc55f0afb None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:46.452570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b15907-cc2f-48fd-86c9-483cc55f0afb None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:46.492630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:46.497558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:46.498220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.498509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.498787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.499375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:46.501623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:46.510748 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:46.517488 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:46.518363 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 441/884] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:46.522942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:46.621390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:46.628979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bd7b6-7a14-4cc1-9f90-580bb494b448 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:46.664812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:46.665430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.665715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.666033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.666895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:46.667272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:46.668813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756e1a6-66fb-4d8e-aad4-fa58f087526d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:46.674965 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 444/885] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:46.680795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:46.792763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89743-6714-47f4-9c83-e09e2a921f26 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:46.828739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:46.829449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.829735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.830043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.830936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:46.831245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:46.832622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:46.838038 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 442/886] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:46.842247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb1d17-f2d6-4478-8c6a-ad1d710c3b27 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.842535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb1d17-f2d6-4478-8c6a-ad1d710c3b27 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.842813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb1d17-f2d6-4478-8c6a-ad1d710c3b27 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.844748 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 445/887] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:46.845149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:46.851300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.851584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.851864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.871570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:46.872870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:46.912205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:46.959685 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 446/888] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:46.964335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53255db0-bbb8-4f90-9c10-14d99089921e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:46.982920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.026564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.027329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.027684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.028033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.028808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] RBAC: Adding query filter params (interface=public, service_id=315faa49d3fc4c4fa1f82c3e69c91e9a, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:47.029195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.031690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.043367 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 443/889] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:46 2022] GET /identity/v3/endpoints?service_id=315faa49d3fc4c4fa1f82c3e69c91e9a&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:47.046329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.084053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.099037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165bb4a-01cf-40d6-b87a-8816e78c4501 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.139104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.140166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.141450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.141983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.142838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.144555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733ab2-57dd-4da3-b2ce-51da2fc5ba5b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.166180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad6d8-16de-4948-ab42-cb2a2e73d56a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.191960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.202446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.203666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.204188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.204565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.205478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.206891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc7fbe-1f7a-4b63-a2e1-87d8e9afc91b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.213132 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 444/891] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:59:47.213701 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 447/891] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:46 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:47.218036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767301-b3a3-4789-8181-45d57351f644 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.218675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619d95-fae6-426d-8b84-da2666a54b6b None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.218675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619d95-fae6-426d-8b84-da2666a54b6b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.218848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619d95-fae6-426d-8b84-da2666a54b6b None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.219460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767301-b3a3-4789-8181-45d57351f644 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.220097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767301-b3a3-4789-8181-45d57351f644 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.220731 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 445/892] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:47.227201 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 448/893] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:47.228948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.229577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.230161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.233205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.233517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.233771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.252759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:47.254518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:47.254843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:47.256138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:47.354283 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 446/894] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:47.358376 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 449/895] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:47.373333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.377029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.488874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.498385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279d0c1-b017-4bff-ace7-504d90d6d0af None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.517032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212fb36-027d-4b89-a419-922c391030a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.520993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.550025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.550661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.550963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.552334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.553656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.554334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.554618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.554892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.555482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.556849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.564956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:47.566471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:47.567378 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:47.568255 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:47.570854 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:47.572094 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:47.573049 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 447/897] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:47.573886 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 450/897] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:47.574712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.579903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.686580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b2e2-a9ec-4373-9d78-4c689d580139 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.707272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29849c2-3cdf-4afe-b776-4f0c42fb92e5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.729494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.730135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.730418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.730693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.731364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:47.731671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.733042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.746880 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 451/898] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:47.747811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.751252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.752106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.753350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.754583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.755031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.755818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:47.756267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.757785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.765033 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 448/899] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:47.770490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.830960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.862294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963cdc2-e3fd-4b84-aca1-099e20384440 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.897863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.898519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.898802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.899079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.911214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.912848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.916528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd019-f520-4bda-8aff-e93593ba52d5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:47.927698 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:47.928711 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:47.929601 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:47.929601 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:47.929601 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:47.933938 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 452/900] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:47.934779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:47.965705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.966955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.967675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.969302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.970438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:47.971212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.973051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.984273 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 449/901] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:47.993509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.005515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.054638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b42a2-cb64-457f-88bf-b8fdc4f99ffc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.089648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.090313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.090601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.090873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.091762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:48.091882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.093217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.111648 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 453/902] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:48.113051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.130659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c04563-2a98-468b-9e56-8301a54edc32 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.132974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.177972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.179523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.179962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.180661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.181961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] RBAC: Adding query filter params (interface=public, service_id=1758ac2fc9244fa58cc7b6d957174fc2, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:48.182670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.184191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.192461 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 450/903] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:47 2022] GET /identity/v3/endpoints?service_id=1758ac2fc9244fa58cc7b6d957174fc2&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:48.200453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.228139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a756a-e405-4b51-94de-9f83ccfd46af None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.247092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.266995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.267692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.267975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.268739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.277697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.279459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:48.296150 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:48.297313 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:48.298468 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:48.301905 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 454/904] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:48.304398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.341675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3797-7c6e-419c-864c-1641c6414169 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.386082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.386987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.387418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.387980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.388742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.391590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.404254 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 451/905] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:48 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:59:48.436680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9170eb-e61c-4463-8c59-35345db57881 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.479006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.479871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.480306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.480751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.481698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:48.482188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.483809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.506382 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 455/906] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:48.514978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.547749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.622179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f142a8-3462-457d-9a44-850d7486b8ad None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.657973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.658582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.658864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.659139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:48.727447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:48.728911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:48.758974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.839481 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 452/907] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:48.840990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:48.877165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:48.958440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac73d6-da91-47f4-a675-bf1c0725f314 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:48.995914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:48.996546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:48.996866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:48.997158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.007902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.009418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:49.024892 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:49.026009 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:49.026936 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:49.026936 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:49.026936 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.029934 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 456/908] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:49.032723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.135537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d034-b8a2-4d1f-ade7-d9d33802c349 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.166380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.172596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.173229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.173509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.173784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.174464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:49.174768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.176211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9dc3c-0af3-4475-8441-ede8949e64ba None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.193858 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 453/909] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:49.195258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.286989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.302532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7193d-a14c-436d-b280-632938490054 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.338716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.339342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.339622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.339897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.347166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.348689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.353971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cc682-7759-45d9-8f2e-fd758f8e691a None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.354421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cc682-7759-45d9-8f2e-fd758f8e691a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.354498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cc682-7759-45d9-8f2e-fd758f8e691a None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.355839 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 454/910] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:49.360403 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:49.362455 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:49.364693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.365778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b5cc-0046-43b3-a332-37a0f556f03d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.365778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b5cc-0046-43b3-a332-37a0f556f03d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.365778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b5cc-0046-43b3-a332-37a0f556f03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.370344 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 457/911] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:49.370344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.383104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2955b5cc-0046-43b3-a332-37a0f556f03d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:49.384371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2955b5cc-0046-43b3-a332-37a0f556f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:49.456910 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 455/912] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:49.458172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f437-d32c-4e45-8b00-97c046a93315 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.458462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f437-d32c-4e45-8b00-97c046a93315 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.458736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f437-d32c-4e45-8b00-97c046a93315 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.459966 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 456/913] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:49.465319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.465604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.465914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.484642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:49.485997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:49.488591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a208-469f-4b8d-a120-a18957b2ec3d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.526517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.527817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.528260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.528688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.529525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:49.530363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.532539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.544536 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 458/914] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:49.545508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.557793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.559512 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 457/915] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:49.563444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.624301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.665958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa924-97fd-421f-a898-b412f03cd30e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.676114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe94ca6-4a57-4ae6-9ecb-63a72daf880d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.704482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.705376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.705652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.705952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.706594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.707888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.713180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.713775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.714081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.714352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.715097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] RBAC: Adding query filter params (role.id=b872065fcaf24c67b3cc38b8c7fef998, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=2a756f12e29a4854be7a4ff1ef0d574c) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:49.715406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:49.716721 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:49.717681 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:49.719263 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.720011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.720092 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 459/916] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:49.720092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.738825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 458/917] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/role_assignments?user.id=2a756f12e29a4854be7a4ff1ef0d574c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=b872065fcaf24c67b3cc38b8c7fef998 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:49.738825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.811054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.846326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f866f-461f-4d32-bf36-750ca7721248 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.879183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f1d6-6d35-4f05-9e39-bbbf5152d90c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:49.895112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:49.896552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.897514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.898013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.898614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.899780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.901341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:49.914015 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:49.915201 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:59:49.916039 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:49.918589 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 460/918] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:49.924322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:49.924938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:49.925218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:49.925881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:49.926152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:49.926453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:49.928156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:49.928816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:49.942428 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 459/919] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:49.944018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.061776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd7f7-d029-45d0-9ecd-66f64d320e87 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.081052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb1f1-4ef2-4d41-9d19-7a695599199b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.101876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.103056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.103546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.104026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.104885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:50.105451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.107164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.108762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.114626 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 461/920] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:50.119961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.125406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.127161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.127161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.127161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.127795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:50.128297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.129845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.140390 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 460/921] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:50.143288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.209787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.241614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981ab6-aa06-446c-a3da-ad4ea615db07 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.259284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406229-9a04-4cf0-9730-e91974d2fc71 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.277743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.278740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.279215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.279721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.280597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:50.281676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.283256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.288939 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 462/922] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:50.294575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.301805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.302453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.302731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.303003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.303699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] RBAC: Adding query filter params (interface=public, service_id=5f183225ffaf41018d0e6e27ff1a31a9, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:50.304009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.305366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.314039 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 461/923] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/endpoints?service_id=5f183225ffaf41018d0e6e27ff1a31a9&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:50.318280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.381369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.424172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14faf3c-b9e2-468b-897f-78509922469b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.441096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3f77-f691-4e12-b2d9-e9f7019086bf None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.449538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.463869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.464935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.465563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.466071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.466928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.469208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.478622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.479213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.479500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.479779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.480744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.482037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173defe-9ddc-4046-aa02-0169bca01a79 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.489881 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 462/924] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 00:59:50.514524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad713c8-bfa9-484e-9d85-74974daeb7d0 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.514879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad713c8-bfa9-484e-9d85-74974daeb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.515196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad713c8-bfa9-484e-9d85-74974daeb7d0 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.516912 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 463/925] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:50.522787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.523107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.523357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.542348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:50.543991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:50.582439 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 463/926] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:50.640160 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 464/927] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:50.663497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.777204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d8bb-5fc3-4436-9d5e-d6729c31fd60 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.797847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.817690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.818547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.818886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.819222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.819911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.821357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:50.830864 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:50.832037 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:59:50.833184 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:50.834705 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 464/928] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:50.840656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.951603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.958532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d8c73-2217-4ec4-a0b4-9c7541d0489d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.997192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.998136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.998619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.999084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:51.000608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:51.001113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:51.002703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:51.040281 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 465/929] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:51.045714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:51.153055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a658-db0e-42e1-a869-1f6378aaa284 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:51.186612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:51.187815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:51.188096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:51.188372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:51.189009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:51.189375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:51.190768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39de8b-b5f3-4154-a4dc-26e8ff6bcfb1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:51.196078 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 465/930] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:51.201894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:51.313091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172718-b8a1-4dab-a791-7b3b012c24e2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:51.350441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:51.351054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:51.351339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:51.351617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:51.352298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:51.353685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46221424-cd42-40cf-a45b-08e91adb2ffb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:51.476671 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 466/931] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:51.886008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a00d-9b5d-4959-a2c6-1192548f1654 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:51.886546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a00d-9b5d-4959-a2c6-1192548f1654 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:51.886647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a00d-9b5d-4959-a2c6-1192548f1654 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:51.888168 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 466/932] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:51.894115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:51.894409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:51.894691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:51.914168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:51.915367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:51.927630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:51.998166 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 467/933] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:52.017178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a00d-9b5d-4959-a2c6-1192548f1654 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.066844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:52.123439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a00d-9b5d-4959-a2c6-1192548f1654 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.159900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:52.160459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.160748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.161028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.172441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:52.177158 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:52.178172 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:52.180332 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 467/934] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:52.184584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.289117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf958-29de-4ee9-9712-daa98f69e484 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.325365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:52.326005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.326292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.326566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.327234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:52.328188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:52.329848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:52.338682 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 468/935] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:52.344579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.448857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3fec-22ad-4ee5-9bb0-13fecbe8ef35 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.456250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:52.494571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:52.495204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.495481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.495751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.508203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:52.509643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b7c9816e-33bf-46fd-a80c-43ca27e0c30f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:52.523842 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:52.526209 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:52.528385 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:52.528385 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:52.528385 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:52.528385 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 468/936] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:52.531268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.535674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:52.627164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a944-1a11-4a5c-ae1b-111d52cb1e34 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.627523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a944-1a11-4a5c-ae1b-111d52cb1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.627714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a944-1a11-4a5c-ae1b-111d52cb1e34 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.629400 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 469/937] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:52.634126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469da8a6-e6f1-4ae4-8747-601d5045b15b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.634416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469da8a6-e6f1-4ae4-8747-601d5045b15b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.634702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469da8a6-e6f1-4ae4-8747-601d5045b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.638587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419127a4-f2c5-4531-b0f7-ff9c32ba62ae None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.653867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-469da8a6-e6f1-4ae4-8747-601d5045b15b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:52.655105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-469da8a6-e6f1-4ae4-8747-601d5045b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:52.684610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:52.685473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.685997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.686311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.687119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:52.687573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:52.689271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:52.701694 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 469/938] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:52.711138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.749931 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 470/939] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:52.752109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46c71-275b-4572-8af4-ed8de13eb9e8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.752397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46c71-275b-4572-8af4-ed8de13eb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.752673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46c71-275b-4572-8af4-ed8de13eb9e8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.754450 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 471/940] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:52.760054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.760342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.760620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.785256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:52.786729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:52.788295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:52.825956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5fea1-6134-4828-829b-8b2dd3311bb1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.861881 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 472/941] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:52.861881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.864594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:52.865218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:52.865504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:52.865780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:52.873121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:52.874709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:52.883815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:52.886784 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:52.887731 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:52.888661 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 470/942] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:52.889281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:52.987492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323149-fce0-4dfe-90eb-0a59b93ae51e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:52.994422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fff80-cf96-415c-85f7-1f55f71b5f38 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.026500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.032267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.033181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.033625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.033950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.041938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.041938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.042133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.042133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.042133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.042133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.042425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.042425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.043385 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING keystone.server.flask.common [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:53.044610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:53.045623 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:53.047136 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 473/943] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:53.047961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.088885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.sql.core [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:59:53.088885 dv-cinder-master-3-smb devstack@keystone.service[80509]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:59:53.088885 dv-cinder-master-3-smb devstack@keystone.service[80509]: [parameters: {'id': 'fc282481b1534fc7b0cdd1dfc47b921f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:59:53.088885 dv-cinder-master-3-smb devstack@keystone.service[80509]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80509) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc282481b1534fc7b0cdd1dfc47b921f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc282481b1534fc7b0cdd1dfc47b921f. Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:53.106238 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 00:59:53.109917 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application yield resource Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise self.value Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application session.commit() Aug 07 00:59:53.110908 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:59:53.111824 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:59:53.112783 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:53.113767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [parameters: {'id': 'fc282481b1534fc7b0cdd1dfc47b921f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.115732 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:53.117661 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fc282481b1534fc7b0cdd1dfc47b921f. Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 471/944] 10.222.0.36 () {60 vars in 1140 bytes} [Sun Aug 7 00:59:52 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:53.119768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.141131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.162085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1533-667c-4276-8657-46f0418f63e5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.198068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.198839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.199183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.199466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.200192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:53.200505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.201965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.225226 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 474/945] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:53.225226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.228846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f27c0-4202-45ce-a97d-9fc1e788bac5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.269218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.270168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.270654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.271125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.271943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:53.272457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.274142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.288912 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 472/946] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:53.288912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.326221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba681a-d8e1-40df-9a07-cabba064a634 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.342194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.365524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.366239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.366525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.366800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.376298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.376298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.380980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:53.390282 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:53.393058 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 475/947] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:53.394337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.406578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ec4e-7c8b-4627-8cda-5989f0d97ccb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.452012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.453085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.453368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.453937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.467356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.470225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:53.488298 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:53.489287 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:53.490175 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:53.490175 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:53.490175 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:53.490360 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 473/948] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:53.491023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.500915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6100e-f43e-4252-b665-501d69cbf41c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.538935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.539471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.539755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.540033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.540665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:53.540973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.542445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.552156 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 476/949] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:53.552156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.596613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.602254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f26f-8542-4231-abb9-ed68e96e4ddd None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.614154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.635839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.636649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.638281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.638281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.638281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:53.638281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.639569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.650649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828159-d955-4a29-951c-7f4fc675e292 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.657530 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 474/950] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:53.658425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.701709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.702887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.703222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.703494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.704149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:53.704454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.706135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb44e5-6c20-4c55-b951-1424a05443f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.720177 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 477/951] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:53.721544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c778-786e-491b-b386-8d083207d364 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.721862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c778-786e-491b-b386-8d083207d364 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.722130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c778-786e-491b-b386-8d083207d364 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.723566 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 478/952] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:53.726628 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056c778-786e-491b-b386-8d083207d364 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.778411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fda67-8554-4c02-9feb-3df090be6df6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.817015 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.817568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.817804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.818080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.818747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.820138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee2ba-80ac-4a0d-a8ba-83b370d34c16 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.880455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056c778-786e-491b-b386-8d083207d364 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.904010 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 475/953] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:53.905106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.906636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.907852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.908142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.928667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:53.931193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:53.932118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.932768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.933043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.933310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.946219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.946913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.948938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:53.963397 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:53.964436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:53.965417 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 479/954] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:53.972691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.041955 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 476/955] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:54.066821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.097530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a296ab-8364-43d9-ba4d-cd4df37e7085 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.141530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.142177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.142466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.142743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.143446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:54.143761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.145204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.160165 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 480/956] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:54.166010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.191543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e0ede-a65c-4eec-8095-9d13bee64b39 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.211071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:54.238256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.238899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.239190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.239535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.240303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.242244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:54.257951 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:54.259288 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:54.260300 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 477/957] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:54.265360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.276016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:54.285342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f5d3-780a-4277-8d6d-270b05c47960 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.321568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.322254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.322538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.322812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/2a756f12e29a4854be7a4ff1ef0d574c/roles/b872065fcaf24c67b3cc38b8c7fef998` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.325414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=2a756f12e29a4854be7a4ff1ef0d574c, role_id=b872065fcaf24c67b3cc38b8c7fef998)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.326880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.375447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302993c9-4dfa-4f25-9422-d60b6df3caf0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.397523 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 481/958] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 00:59:54 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/2a756f12e29a4854be7a4ff1ef0d574c/roles/b872065fcaf24c67b3cc38b8c7fef998 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:54.423035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.423969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.424398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.424852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.425721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:54.426221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.427814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65529c13-eec3-4998-8d3f-702a0b1601bb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.434588 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 478/959] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:54.440790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.558280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c69f0-0383-449a-bea5-d6ef99c37922 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.561555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:54.599650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.600510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.601141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.601555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.602370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:54.602827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.604330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334653-1b5b-44e3-85c8-1f9d7de0ea38 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.609488 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 482/960] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:55.885309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10bf-c791-4657-94e6-e05d1db1278d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:55.885309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10bf-c791-4657-94e6-e05d1db1278d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:55.885309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10bf-c791-4657-94e6-e05d1db1278d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:55.886431 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 479/961] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:55.892302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fa37-7a5c-474d-8e92-191adf901cf7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:55.893047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fa37-7a5c-474d-8e92-191adf901cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:55.893478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fa37-7a5c-474d-8e92-191adf901cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:55.911974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9619fa37-7a5c-474d-8e92-191adf901cf7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:55.913363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9619fa37-7a5c-474d-8e92-191adf901cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:55.985069 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 483/962] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:56.008223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf10bf-c791-4657-94e6-e05d1db1278d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.082603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.101609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25096cc-2ce7-49a4-98e2-30c932451147 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.101936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25096cc-2ce7-49a4-98e2-30c932451147 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.102205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25096cc-2ce7-49a4-98e2-30c932451147 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.103783 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 484/963] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:56.109820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.110170 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.110503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.117709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf10bf-c791-4657-94e6-e05d1db1278d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.133202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:56.134434 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.167973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.169018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.169527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.170036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.170988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.173216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.211451 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 485/964] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:59:56.235397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.245765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.sql.core [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:59:56.245765 dv-cinder-master-3-smb devstack@keystone.service[80509]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:59:56.245765 dv-cinder-master-3-smb devstack@keystone.service[80509]: [parameters: {'user_id': '2509dff121c040b7800bb344946234fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:59:56.245765 dv-cinder-master-3-smb devstack@keystone.service[80509]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80509) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:56.254950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:56.255843 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application yield resource Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise self.value Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application session.commit() Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:59:56.256856 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:59:56.257772 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:59:56.258692 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application result.read() Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:59:56.259559 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [parameters: {'user_id': '2509dff121c040b7800bb344946234fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:56.261416 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 00:59:56.263046 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 480/965] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:56.264135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.274745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.375771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ca33-dac7-404a-9926-1cbb86765ca8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.396314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf60ab-2ed7-4bc0-9b5f-78cf0438a3e6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.413395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.414183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.414949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.415637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.417094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:56.427270 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:56.428532 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:56.429380 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:56.430151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 486/966] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:56.441857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.442810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.446512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.447515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.447821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.448155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.459873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.462224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:56.478151 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:56.479123 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:59:56.480077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:56.481921 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 481/967] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:56.486240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.544551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.558288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8810-6103-45ea-95aa-899f02d3d7a2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.594027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bef7f-41ef-4e41-8fc8-72c1dbdf7c2d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.594744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.595539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.595934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.596088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.596718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:56.597018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.598465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b379a-c897-4251-99fa-8aee6d14beb0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.603554 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 487/968] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:56.604510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2d93-d37e-4f16-991e-dcaf4022bcf3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.604790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2d93-d37e-4f16-991e-dcaf4022bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.605061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f2d93-d37e-4f16-991e-dcaf4022bcf3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.606428 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 488/969] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:56.611372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2d93-d37e-4f16-991e-dcaf4022bcf3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.636009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.636730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.637013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.637534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.638199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:56.638503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.640721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64169d2-5d91-454c-b8c1-d7a1bd5d6a90 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.688185 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 482/970] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:56.688185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc44a1-a2e9-4075-8f75-70ab285201f6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.688185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc44a1-a2e9-4075-8f75-70ab285201f6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.688185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc44a1-a2e9-4075-8f75-70ab285201f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.706399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d2dc44a1-a2e9-4075-8f75-70ab285201f6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:56.708012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d2dc44a1-a2e9-4075-8f75-70ab285201f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.728417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f2d93-d37e-4f16-991e-dcaf4022bcf3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.761694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.771454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.772608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.773042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.773609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.774856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:56.775586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.777659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0253a-7d51-40f2-9e5d-07096120ac20 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 483/971] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839aff-e5cb-43b2-889f-d6fb78b62b49 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839aff-e5cb-43b2-889f-d6fb78b62b49 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839aff-e5cb-43b2-889f-d6fb78b62b49 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 484/972] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:56.790546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839aff-e5cb-43b2-889f-d6fb78b62b49 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.791383 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 489/973] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:56.798604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.798885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.799160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.818620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:56.819758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.832733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.901964 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 490/974] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:56.902843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.916643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839aff-e5cb-43b2-889f-d6fb78b62b49 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.959509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.960143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.960486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.960827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.961598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] RBAC: Adding query filter params (interface=admin, service_id=5f183225ffaf41018d0e6e27ff1a31a9, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:56.962038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.963387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.969077 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 485/975] 10.222.0.36 () {56 vars in 1249 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/endpoints?service_id=5f183225ffaf41018d0e6e27ff1a31a9&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:56.970111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.009626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06199469-583f-4569-bed3-294dc5f95c86 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.016477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:57.043789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.044412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.044753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.045034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.055494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:59:57.060161 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:57.061122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 491/976] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:57.062555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.071600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:57.072366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1fc6e-b49b-4a61-8104-d01560b50047 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.105909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.106509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.106784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.107055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.107685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.109672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.161288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0c688-7d8b-42d4-95fd-aa62a0294aa3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.183277 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 486/977] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:57.184185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.211769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.212402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.212747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.213094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.213824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.215394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.233866 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 492/978] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:59:57.322226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9fa5f-3074-407c-91b3-180353aaae74 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.325200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:57.366974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.367909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.368369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.368860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.369611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:57.370026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.371519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.386006 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 487/979] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:57.388814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.459118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:57.493096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbed45a-f073-41aa-a097-9e8b85bbf0a0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.528237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.528954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.529298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.529634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.539979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.541509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:57.557299 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:57.558558 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:57.559646 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:57.559646 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:57.559646 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:57.564652 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 493/980] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:57.566162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.669478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b7e2-69d9-4f54-993b-0c9f5fae5314 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.704712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.705575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.705879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.706163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.706805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:57.707111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.708485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.725048 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 488/981] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:57.726853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.830162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a5b3a-9873-4d4a-b6c8-6fd9d15cd07d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:57.846789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:57.863533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:57.864252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:57.864590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:57.864926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:57.872558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:57.874685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:59:57.885939 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:57.887086 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:59:57.888279 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:57.895702 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 494/982] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:57.896929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:57.927074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:58.007841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472e2a-38b1-4bd0-aa2e-4de278a475d2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:58.041515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:58.042130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:58.042411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:58.042682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:58.043394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:58.043700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:58.045117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:58.065995 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 489/983] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Aug 7 00:59:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:58.068558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:58.166407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac012-d10f-4f2c-81b4-051a06a844df None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:58.198394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:58.199041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:58.199324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:58.199597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:58.246519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:58.268495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:58.269971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:58.372037 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 495/984] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 00:59:58 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:58.378134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:58.462311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:58.478427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df071c-73ea-43fb-a67f-eb88c9efdafb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:58.512224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:58.512839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:58.513119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:58.513389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:58.523248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:58.524679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:59:58.539073 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:58.540035 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:59:58.540959 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:59:58.540959 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:59:58.540959 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:58.541643 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 490/985] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 00:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:58.545760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:58.621958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:58.644463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df4b1-721f-4968-9291-866e01663635 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:58.678531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:58.679135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:58.679412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:58.679684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:58.680317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:58.680619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:58.682004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:58.693976 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 496/986] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 00:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:58.699244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:58.798747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fc1e2-2057-4177-81f7-815cb98e07e0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:58.832195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:58.832820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:58.833102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:58.833374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:58.836075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:58.840856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:58.842416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:59:58.856950 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:58.858768 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:59:58.860139 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:58.861030 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 491/987] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:58.864969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:58.966527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a93d-e9f6-48b8-8c79-d29bc594a0cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.008209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.009068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.009744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.010196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.011067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.011531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.013175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced44fe4-bae2-46b5-b3c4-4d953da98d61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.021590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.027434 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 497/988] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 00:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:59.033560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.138858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbed10f-2f83-42d5-9d37-24e89008edc4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.173574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.174202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.174481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.174752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.175468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] RBAC: Adding query filter params (role.id=b872065fcaf24c67b3cc38b8c7fef998, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=2a756f12e29a4854be7a4ff1ef0d574c) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.175776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.177185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a478-cce4-458a-bd23-d796bba3bef8 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.189933 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 492/989] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/role_assignments?user.id=2a756f12e29a4854be7a4ff1ef0d574c&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=b872065fcaf24c67b3cc38b8c7fef998 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:59.259772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312b84-d32b-4519-8c5f-4d7d72336ad7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.260340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d681-1b3f-4657-8ee3-23c0ad823ccc None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.260438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312b84-d32b-4519-8c5f-4d7d72336ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.260523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d681-1b3f-4657-8ee3-23c0ad823ccc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.260602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312b84-d32b-4519-8c5f-4d7d72336ad7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.260789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d681-1b3f-4657-8ee3-23c0ad823ccc None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.263862 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 498/990] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:59.264013 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 493/991] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 00:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:59.267782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.268094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.268466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.271318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.271609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.271888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.287680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:59.288898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:59.290968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:59.292145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:59.356718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.367965 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 499/992] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:59.368221 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 494/993] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:59:59.390852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.391039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.491570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86129-5631-4bf3-b6d1-2e7372dfa8cf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.498750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306bd76-2c98-43e9-bd22-ad223392c3e4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.518076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.526821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.529202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.529202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.529202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.529202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.530006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.535870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.536739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.537211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.537657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.538433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:59.538844 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:59.539792 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 00:59:59.540655 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 500/994] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:59:59.542808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.546857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:59:59.553145 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:59:59.554183 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 00:59:59.555030 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 495/995] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:59:59.560553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.621847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.652827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8473152-4111-4866-ab20-9bacc299a777 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.675126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c68a-47d7-45ef-8822-b2eebdc956c6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.690958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.691817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.692256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.692772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.694102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.694605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.696118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.701974 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 501/996] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:59.708193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.714794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.715396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.715677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.715950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.716580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.716884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.718313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.723131 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 496/997] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:59.728695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.773501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.819271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8893867-799e-46c7-a529-08b4d7bbc848 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.836958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d74ee-48f9-4cdc-9cea-c0abd6d2d9c3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:59.855050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.856880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.857498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.857913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.858748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.860052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.860386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.861744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.871240 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 502/998] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:59:59.872278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.878148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:59.878763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.879099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.879371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.880051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:59.880334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:59.881688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:59.886866 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 497/999] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:59.892369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.982168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dafa2-1916-459f-b07a-3b482d9a47ec None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:00.004770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:00.016027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a86530-c06a-4947-9255-64fa43829160 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:00.021341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:00.021341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:00.021341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:00.021341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:00.021990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:00.023334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49b67-f625-44f4-9cfe-f4c78d72177d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:00.051750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:00.052355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:00.052640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:00.052917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:00.053611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] RBAC: Adding query filter params (interface=public, service_id=07d7f9be38044b8ab94964427ba691e5, region_id=RegionOne) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:00.053955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:00.055307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:00.060315 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 498/1000] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/endpoints?service_id=07d7f9be38044b8ab94964427ba691e5&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:00.065920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:00.113862 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 503/1001] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:00:00.122618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:00.181106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449993c8-3f73-4164-ada0-d38c58ada214 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:00.224407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:00.225021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:00.225301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:00.225571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:00.226209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:00.227586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a5dcb-935b-479d-b0fe-90586b9899a3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:00.235322 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 499/1002] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 01:00:00 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:00:01.267114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f06d-090b-44c0-8c02-5b945d47a943 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:01.267588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f06d-090b-44c0-8c02-5b945d47a943 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:01.267588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f06d-090b-44c0-8c02-5b945d47a943 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:01.269193 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 504/1003] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:01.274621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:01.275061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:01.275198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:01.295823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:01.297177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:01.388674 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 500/1004] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:01.406273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f06d-090b-44c0-8c02-5b945d47a943 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:01.514029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f06d-090b-44c0-8c02-5b945d47a943 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:01.548167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:01.549031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:01.549452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:01.549900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:01.550641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:01.552150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:01.561794 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:01.563000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:01.564036 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:01.566663 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 505/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Aug 7 01:00:01 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:01.572420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:01.624600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:01.695273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20098c-a62e-4806-b85e-f1316ada4681 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:01.732137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541534-8343-45af-8877-087ded112b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:01.732738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541534-8343-45af-8877-087ded112b2c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:01.733762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541534-8343-45af-8877-087ded112b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:01.734027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541534-8343-45af-8877-087ded112b2c None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:01.734507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541534-8343-45af-8877-087ded112b2c None admin] RBAC: Adding query filter params (name=image) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:01.734810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541534-8343-45af-8877-087ded112b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:01.736174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541534-8343-45af-8877-087ded112b2c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:01.745962 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 501/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:01.746915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:01.793737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:01.849352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc93a7-e8d7-48d3-a547-ab012d14f32c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:01.884459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:01.885346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:01.885771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:01.886207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:01.886986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] RBAC: Adding query filter params (type=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:01.887437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:01.888975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0848d2-4b6c-416b-ac20-2a5e5a606f3d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:01.899782 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 506/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:02.195020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ac93-3d49-422a-91bf-4901b2a48edd None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.195321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ac93-3d49-422a-91bf-4901b2a48edd None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.195530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ac93-3d49-422a-91bf-4901b2a48edd None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.197123 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 502/1008] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:02.202850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.203303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.203590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.222301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:02.223500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:02.284818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1d06-b896-40f5-b92f-ce2a5569db4d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.285334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1d06-b896-40f5-b92f-ce2a5569db4d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.285334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1d06-b896-40f5-b92f-ce2a5569db4d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.286734 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 503/1009] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:02.291666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.291951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.292225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.297873 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 507/1010] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:02.310137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:02.311844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:02.318821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:02.361327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:02.387385 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 504/1011] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:02.410758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:02.427376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87406d-95c6-40ca-a7c3-37308ccfad1d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:02.440223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:02.464593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:02.465270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.465559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.465865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.466984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:02.468799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:02.470516 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 508/1012] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:02.476039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:02.512330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524184a-e176-4b15-af77-4a61aa456fa6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:02.548365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:02.548995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.549273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.549548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.550158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:02.551527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:02.559960 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:02.560961 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:02.562646 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 505/1013] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:00:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:02.567517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:02.595082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb732ff-69a3-4262-a2f6-77e5a05a811b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:02.603208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:02.634691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:02.635561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.635872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.636706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.637367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:02.639957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:02.665711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:02.672444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e4810-d391-48ce-afb6-d30577327edf None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:02.706573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:02.707174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.707459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.707738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.708368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:02.708676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:02.710179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:02.715045 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 506/1014] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 01:00:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:02.721954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:02.727450 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 509/1015] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 01:00:02 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:00:02.840940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77abded-46fe-41f7-81ab-0dbeec6421bc None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:02.879885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:02.880501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:02.880785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:02.881066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:02.881705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:02.882047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:02.883408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287fa73-c396-4a57-9478-79125206b56d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:02.888754 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 507/1016] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Aug 7 01:00:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:02.895172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:03.009784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a7004-04f5-4f37-8f23-4fb5b450126f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:03.045222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:03.046559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:03.046834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:03.047102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:03.047767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:03.049143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19419c-f44f-4ed6-b694-2884be2614fd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:03.118477 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 510/1017] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:00:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:03.916216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f8952-f3f9-4fb6-a55d-e1579406b880 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:03.916737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f8952-f3f9-4fb6-a55d-e1579406b880 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:03.916816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f8952-f3f9-4fb6-a55d-e1579406b880 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:03.918151 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 508/1018] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:03.923835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f687e4-d21d-47d3-8f2b-cd8aba78cd66 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:03.924279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f687e4-d21d-47d3-8f2b-cd8aba78cd66 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:03.924453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f687e4-d21d-47d3-8f2b-cd8aba78cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:03.942626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-70f687e4-d21d-47d3-8f2b-cd8aba78cd66 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:03.943807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-70f687e4-d21d-47d3-8f2b-cd8aba78cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:03.954335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:04.023602 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 511/1019] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:03 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:04.046843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f8952-f3f9-4fb6-a55d-e1579406b880 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:04.071556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:04.148590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f8952-f3f9-4fb6-a55d-e1579406b880 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:04.181757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:04.182358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:04.182643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:04.182913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:04.183543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:04.184904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed040ae-ec3b-4e52-b906-33726d1b4224 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:04.287125 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 509/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 01:00:04 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:04.797488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4653-c6d2-40fb-acfd-2af074e49c9a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:04.797892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4653-c6d2-40fb-acfd-2af074e49c9a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:04.798094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4653-c6d2-40fb-acfd-2af074e49c9a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:04.799573 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 512/1021] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:04.804558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:04.804849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:04.805123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:04.824388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:04.825572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:04.898805 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 510/1022] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:04.922993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4653-c6d2-40fb-acfd-2af074e49c9a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.032983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4653-c6d2-40fb-acfd-2af074e49c9a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.066646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.067202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.067485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.067765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.069011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:05.070524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2247fe-233c-412b-b0f9-17a8fc85cfe3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:05.073864 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 513/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:05.078586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.089045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:05.178750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0c6c0-a1ca-468a-bafe-fff0650f66b5 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.213111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.213716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.214025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.214304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.214955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:05.216398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:05.231732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97954fc-f6a9-43c4-b83e-5bed1080a7bc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.232212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97954fc-f6a9-43c4-b83e-5bed1080a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.232551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97954fc-f6a9-43c4-b83e-5bed1080a7bc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.234237 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 514/1024] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:05.238665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.238947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.239219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.257942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:05.259130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:05.261168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:05.315456 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 511/1025] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 01:00:05 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:00:05.326322 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 515/1026] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:00:05.350728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.417382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:05.461424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e019-de0c-43d6-8c2e-946245697a6d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.499591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.499801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.499916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.500177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.511817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:05.517564 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:05.518515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:05.519619 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 512/1027] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 01:00:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:05.527626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.630485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887343a-90a1-490a-96b4-4d49e35a06a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.664729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.665336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.665621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.665917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.666581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:05.666891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:05.668255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:05.673751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:05.677618 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 516/1028] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 01:00:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:05.683331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.787530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0dbe2-f3b2-42c8-bfdf-b473cb9e13df None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.810461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:05.821630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.822301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.822567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.822842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.834211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:05.835663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:05.850927 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:05.851878 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:05.852767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:05.852767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:05.852767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:05.853978 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 513/1029] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:05.858096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:05.960381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cde3b-e887-470d-96e7-9bdd973585a3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:05.995666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:05.996271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:05.996548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:05.999722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:05.999722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:05.999722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:05.999722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.017501 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 517/1030] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:06.018740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.119898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d44170-0fc4-4a79-8937-82f1cc6e676d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.153827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.154476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.155275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.155677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.164174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.165610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:00:06.177102 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:06.178076 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:06.179362 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 514/1031] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:06.183938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.264506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.285750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6775-91ed-4252-babf-fae2312c8601 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.319506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.320104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.320379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.320648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.321366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:06.321667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.323118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d615985-bd67-4ad5-8453-6a08adcbcb7d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.341996 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 518/1032] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:06.347296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.383432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450265-b2fd-4e93-b58f-d1de5e14d8f1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.383634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.383715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450265-b2fd-4e93-b58f-d1de5e14d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.383715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450265-b2fd-4e93-b58f-d1de5e14d8f1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.385004 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 519/1033] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:06.390255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.390543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.394526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.408985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:06.410207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:06.458108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8c1fe-a302-4baa-ad28-b7a3a312ea4f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.489859 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 520/1034] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:06.495766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.496481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.496835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.497184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.509990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.566396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.577224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.583066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.612650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.619847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702eac2-b6ae-411e-977a-ba4fb506e0a3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.656078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.656698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.656983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.657257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.657863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.659470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:06.668529 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:06.669535 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:06.671080 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 521/1035] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:06.676227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.685449 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 515/1036] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:06.686506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.781543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8a4f6-5c47-4099-ab3e-e0b5fc286aa8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.788789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1435c2-f8e2-4cb1-87ea-cea466e5ff3b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.795743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.819291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.819823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.820111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.820388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.821018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:06.821323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.822742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.825481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.826143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.827155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.827465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.833951 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 522/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:06.835030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:06.835515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.843396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.844854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:06.859388 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:06.860392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:06.861415 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:06.861415 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:06.861415 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:06.861415 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 516/1038] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:06.866112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:06.952916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671fc0d-ecf9-475e-b5bc-d48a816003d2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.973783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06082a0-b3ba-45c1-b276-21697881a8e4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:06.995177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:06.995783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:06.996068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:06.996344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:06.996980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:06.997283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:06.999153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.016097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.016702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.016987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.017264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.017935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:07.018247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.019677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.033744 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 523/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:07.034562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.036527 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 517/1040] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:07.037413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.080797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.090913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.141727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1004-45d1-43bb-83b5-79ce39e9c9a9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.141946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81323da-75e3-48c8-9c5c-f6c746c93fc3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.177281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.177914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.178201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.178303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.178479 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.178925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.179175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] RBAC: Adding query filter params (interface=public, service_id=4786a891d22040f1a16b22f7e2c61f5d, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:07.179283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.179462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.179566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.180870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.191022 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 524/1041] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/endpoints?service_id=4786a891d22040f1a16b22f7e2c61f5d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:07.191622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.191622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.192076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:00:07.203461 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:07.204395 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:07.205560 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 518/1042] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:07.210472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.299062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4774a-4c02-4f1d-ab7d-0538b1281b46 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.301374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.312643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681f361-52bd-476f-b373-ebd73075c499 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.321755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.336330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.337246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.337756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.338275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.340428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.342742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.350206 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 525/1043] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:00:07.352826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.352826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.352826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.352826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.353109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:07.353109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.354163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcaf36-6245-4497-8ad4-506665c4979f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.370230 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 519/1044] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:07.375321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.432694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7213f-f2e2-49ce-9773-fb285f5c7d04 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.433059 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7213f-f2e2-49ce-9773-fb285f5c7d04 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.433263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7213f-f2e2-49ce-9773-fb285f5c7d04 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.435454 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 520/1045] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:07.441514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.441794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.442103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.467711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:07.468992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:07.490976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c1cb-cc83-47b1-b601-5440aa3fcacf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.532569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.533122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.533397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.533666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.534702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] RBAC: Adding query filter params (role.id=b872065fcaf24c67b3cc38b8c7fef998, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:07.535009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.536423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.545869 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 526/1046] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=b872065fcaf24c67b3cc38b8c7fef998 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:07.546123 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 521/1047] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:00:07.568074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.603983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.680697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1e18-7b0e-4615-9acb-6cd290607e96 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.719778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.720405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.720683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.720955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.731078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:07.735735 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:07.736669 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:07.737514 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 527/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:07.744645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:07.843996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:07.848297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fb9f9-830d-4265-9604-d72c46101ca2 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:07.883430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:07.884100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:07.884486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:07.884860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:07.885620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:07.886070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:07.887538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:07.901340 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 522/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:07.902596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:08.004341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:08.014447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9cedf-06e4-4919-8fcb-2280a88100e9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:08.048844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:08.049474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:08.049752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:08.050059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] PATH_INFO: `/v3/users/3745ccb6b9e94619a4cc77ff1191271d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:08.064587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] RBAC: Authorizing `identity:get_user(user_id=3745ccb6b9e94619a4cc77ff1191271d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:08.066068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:08.070012 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 528/1050] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:07 2022] GET /identity/v3/users/3745ccb6b9e94619a4cc77ff1191271d => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:08.073489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:08.176051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3e166-c361-447d-a3c7-611e94b7eda1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:08.210968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:08.211569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:08.211854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:08.212133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:08.240851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:08.281140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:08.282622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:08.378693 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 523/1051] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 01:00:08.384285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:08.488433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f58a-04d5-419e-8414-1d693ba5c20c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:08.525100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:08.525731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:08.526041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:08.526316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:08.527426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:08.528850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d10c3-b506-4269-8808-679149da5f9b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:08.535826 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 529/1052] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:08 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:08.536949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:08.596957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:08.647114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac85b2-0c0b-455c-ab4c-15627357a144 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:08.683011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:08.683607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:08.683884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:08.684154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:08.684865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=75c0d1b97a94470884335f4d2843a81b, user.id=3745ccb6b9e94619a4cc77ff1191271d) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:08.685170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:08.687349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b909b18-c3fe-4990-8c23-9a0eefb33cd9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:08.701983 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 524/1053] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:08 2022] GET /identity/v3/role_assignments?user.id=3745ccb6b9e94619a4cc77ff1191271d&scope.project.id=75c0d1b97a94470884335f4d2843a81b&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:09.415004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aff0-a7af-43a7-b2e5-1d9600c7b0db None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.415540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aff0-a7af-43a7-b2e5-1d9600c7b0db None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.415540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aff0-a7af-43a7-b2e5-1d9600c7b0db None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.417070 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 530/1054] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:09.423099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d0d5-a89a-447b-95f9-c3cb2a431253 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.423552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d0d5-a89a-447b-95f9-c3cb2a431253 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.423723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d0d5-a89a-447b-95f9-c3cb2a431253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.442250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-bc20d0d5-a89a-447b-95f9-c3cb2a431253 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:09.443445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bc20d0d5-a89a-447b-95f9-c3cb2a431253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:09.509617 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 525/1055] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:09.531712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1aff0-a7af-43a7-b2e5-1d9600c7b0db None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:09.551430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:09.569361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc9bc-f37b-4408-acfb-12df1a9ef58f None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.569716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc9bc-f37b-4408-acfb-12df1a9ef58f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.574901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc9bc-f37b-4408-acfb-12df1a9ef58f None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.574901 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 526/1056] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:09.576647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.576936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.577221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.595332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:09.596515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:09.640485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1aff0-a7af-43a7-b2e5-1d9600c7b0db None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:09.648191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:09.667578 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 527/1057] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:00:09.677739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:09.678401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.678685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.678958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.679542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:09.680905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:09.690306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:09.691320 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 01:00:09.692176 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:09.693415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:09.696151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 531/1058] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Aug 7 01:00:09 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:09.697207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:09.786431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:09.792974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e57d6-514c-43b0-a2c5-c4a307c2f26e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:09.810087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2754735-09a5-4376-b03f-b941be9d4183 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:09.838294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:09.838930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.839238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.839493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.850445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:09.850798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:09.851409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:09.851693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:09.852018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:09.852659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] RBAC: Adding query filter params (name=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:09.852967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:09.854405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:09.855115 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:09.856001 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:09.856873 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:09.864392 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 532/1059] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:09.864523 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 528/1060] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 01:00:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:09.864601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:09.865254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:09.917119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:09.967922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f88cf-b5e6-4d2d-a759-9adb29515982 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:09.973872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0f92-2f24-4cd0-b71e-f3c8de6f956f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.008102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.008710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.008992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.009266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.009982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:10.010292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.011658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.018359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.019137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.019566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.019673 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 533/1061] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 01:00:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:10.020080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.020861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] RBAC: Adding query filter params (type=image) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:10.021312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.022901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.026105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.033432 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 529/1062] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:10.034261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.037145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.126637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112f868-f4d8-4f64-a5cf-feb6e10bdf31 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.141229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfef0b-0738-4447-b199-9adddb92af9b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.151364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.159909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.160539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.160820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.161096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.173260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.174878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.177074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.177687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.178009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.178286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.178941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.180294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:10.190196 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:10.191248 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:10.193000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:10.193000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:10.193000 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:10.193000 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 534/1063] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:10.196864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.255602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.269886 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 530/1064] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:00:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:00:10.301598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149d1cd-51c5-4141-ac47-e01907af730a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.346535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.347161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.347444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.347719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.348387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:10.348696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.350115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.368667 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 535/1065] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:10.370024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.480893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce5b-fc3c-4511-a0b5-fcdfbee02a03 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.515709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.516252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.516533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.516802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.524531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.526000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:00:10.537508 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:10.538515 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:10.539498 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 531/1066] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:10.546885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.648644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891aa8-5486-44da-a293-b2117157c493 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.665786 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.683698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.684379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.684726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.685067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.686393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:10.686798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.688300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b9af9-bbd5-4d18-9d0e-f1c7898aae29 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.711378 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 536/1067] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:10.713571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.741725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.763138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3a00-8a48-4b43-8f2d-3131f7c17296 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.763430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3a00-8a48-4b43-8f2d-3131f7c17296 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.764244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3a00-8a48-4b43-8f2d-3131f7c17296 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.766083 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 537/1068] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:10.771496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.771791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.772071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.790811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:10.792009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:10.824203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4881dc1-d586-4f30-a526-c135e513dd3d None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:10.860452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:10.861078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:10.861358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:10.861631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:10.862507 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 538/1069] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:10.879097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:10.880615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:10.884235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:10.895470 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:10.896475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:10.897387 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:10.897387 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:10.897387 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:10.897387 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 532/1070] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:10.902028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:10.985288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.000410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0af2-ad6f-4a61-afd7-991836d5e190 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.002838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.009567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1df56-448c-413c-b94b-edc56bb10ba0 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.042683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.043919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.044590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.045846 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.050149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.050758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.051044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.051322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.051969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:11.052280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.053652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.059803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:11.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:11.067306 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:11.073708 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:11.074407 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 533/1071] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:11.074481 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 539/1072] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:11.074548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.074615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.176067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69359bd-0041-41a2-8912-1b9427b9bd3f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.183646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43743ead-b5c1-4728-97ef-ad8e8229872a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.211156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.211752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.212026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.212295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.212955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:11.213257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.214652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.220778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.221397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.221681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.221981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.228070 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 540/1073] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:11.228622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.228814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.230579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.231106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:00:11.242555 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:11.248712 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:11.250031 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 534/1074] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:11.250638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.260225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.336302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c17b-21e5-4ea1-80ce-3bc1b14e2925 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.353233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2fa3-d185-434e-b43e-bf9380b6f7d6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.374422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.375331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.375780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.376059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] PATH_INFO: `/v3/users/3745ccb6b9e94619a4cc77ff1191271d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.377192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] RBAC: Authorizing `identity:get_user(user_id=3745ccb6b9e94619a4cc77ff1191271d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.378649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.381866 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 541/1075] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:11 2022] GET /identity/v3/users/3745ccb6b9e94619a4cc77ff1191271d => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:11.386297 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.394556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.395166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.395433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.395707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.396393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:11.396718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.398165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.416439 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 535/1076] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:11.417632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.478700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.490654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:11.497292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf042ae-1619-42db-910b-8971edac3606 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.521583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8414-2de4-4107-95a4-53ca47c43501 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.532491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.533233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.533509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.533783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.534916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.536465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.543092 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 542/1077] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:11 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:11.543986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:11.562979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.563635 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.563932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.564180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/b872065fcaf24c67b3cc38b8c7fef998` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.566375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=f7e1030a5d0842f4b949a37a42ff753d, role_id=b872065fcaf24c67b3cc38b8c7fef998)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.567806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec598d-9a5d-492c-a992-582236b4b5ed None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.634118 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 536/1078] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:00:11 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f7e1030a5d0842f4b949a37a42ff753d/roles/b872065fcaf24c67b3cc38b8c7fef998 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:00:11.649781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1557517-6259-4ae9-b3a3-dc4d4c831f0b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:11.689242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:11.689959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:11.690240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:11.690511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b/users/3745ccb6b9e94619a4cc77ff1191271d/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:11.692527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=75c0d1b97a94470884335f4d2843a81b, user_id=3745ccb6b9e94619a4cc77ff1191271d, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:11.694015 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c32a1-b280-4f60-868b-c93ad6026b9c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:11.760695 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 543/1079] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:00:11 2022] PUT /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b/users/3745ccb6b9e94619a4cc77ff1191271d/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:00:12.337972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81df5a8-646e-4d2a-a4e3-003a897c4b71 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:12.338314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81df5a8-646e-4d2a-a4e3-003a897c4b71 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:12.338435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81df5a8-646e-4d2a-a4e3-003a897c4b71 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:12.339842 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 537/1080] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:12.345497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:12.345791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:12.346109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:12.364239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:12.365424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:12.382216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:12.438223 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 544/1081] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:12.456017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81df5a8-646e-4d2a-a4e3-003a897c4b71 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:12.556698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81df5a8-646e-4d2a-a4e3-003a897c4b71 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:12.572965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:12.591294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:12.591881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:12.592249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:12.592529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:12.659578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:12.661036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:12.760673 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 538/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 01:00:12.767001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:12.870769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d85e1-0947-4dc3-9beb-2e048751b80f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:12.905421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:12.906063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:12.906341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:12.906610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:12.916743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:12.918209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-85813757-0d15-4a00-90ff-27c8b336d4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:12.934160 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:12.935122 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:12.936071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:12.936071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:12.936071 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:12.936071 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 545/1083] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:12.942579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:12.960596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:13.050192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11751e2-401c-4002-ac64-54cce8ae1429 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:13.083868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:13.084466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.084749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.085024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.085660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:13.085996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:13.087363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417adeb6-cdb5-47af-bdac-5bf5ec3d88b9 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:13.099375 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 539/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:13.689594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c98a-a799-4149-bced-7adf4a961981 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.690041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c98a-a799-4149-bced-7adf4a961981 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.690322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c98a-a799-4149-bced-7adf4a961981 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.691671 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 546/1085] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:13.696925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.697357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.697478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.715598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:13.717291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:13.740150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e14c-ac33-4ff9-9389-a9fd6c1e23b0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.740432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e14c-ac33-4ff9-9389-a9fd6c1e23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.740710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e14c-ac33-4ff9-9389-a9fd6c1e23b0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.742057 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 547/1086] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:13.746932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.747217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.747496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.755147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:13.765720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:13.766926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:13.785132 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 540/1087] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:13.809635 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:13.817798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:13.832933 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 548/1088] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:00:13.856315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:13.908800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8351a07-e8d2-4187-b803-637a09a068f9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:13.943185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:13.943744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.944021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.944292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.953983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348dc2-43be-46ea-a849-234b9128b7e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:13.954246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:13.959082 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:13.960178 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:13.961167 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 541/1089] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Aug 7 01:00:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:13.966113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:13.988340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:13.988970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:13.989250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:13.989522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:13.991349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.000283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:14.004918 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:14.010417 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:14.011349 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 549/1090] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:14.012058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.070173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.104355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e3782-23ca-4f14-8c98-a2fb7697dfc9 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.110534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4253-ec6b-4a42-aab8-c43f969ec915 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.138113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.138738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.139109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.139394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.140059 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:14.140369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.141750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.143103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.143704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.143973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.144242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.144893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:14.145194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.146561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.149520 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 542/1091] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 01:00:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.155320 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 550/1092] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.155587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.160690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.214897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.255464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784454aa-bd7c-4387-aa9f-d1309313faf6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.257675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef7425-5371-4405-9de1-db6f4281cf7b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.281253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.289104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.289723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.290036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.290310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.295761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.295761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.295761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.295761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] PATH_INFO: `/v3/users/3745ccb6b9e94619a4cc77ff1191271d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.296133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] RBAC: Authorizing `identity:get_user(user_id=3745ccb6b9e94619a4cc77ff1191271d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.296217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.297745 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 551/1093] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/users/3745ccb6b9e94619a4cc77ff1191271d => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.301528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.303343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.303483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:14.318089 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:14.319112 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:14.319985 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:14.319985 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:14.319985 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:14.319985 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 543/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:14.324712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.402731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f71ac-37b0-42c2-a226-05ebc95bb7eb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.422838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88362-3845-46bb-b862-eb1479cf05bc None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.424778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.435751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.436351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.436633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.438679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.456024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.456613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.456890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.457161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.457795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:14.458127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.459495 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.477633 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 544/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.478607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.504530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.506025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.519171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.577397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78653ce-30cd-471b-8ae0-51420dd57b4e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.603633 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 552/1096] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 01:00:14.610030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.616722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.617351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.617637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.617947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.625475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.626956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.633374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:00:14.638396 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:14.646493 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 545/1097] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:00:14.647729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.709204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729e99-ec6b-472c-8c36-6edafd9c25d2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.741354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.743293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.743939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.744163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb13ee6-6d3d-468c-b452-45c5530298f5 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.744259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.744473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.745580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.747053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.748699 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 553/1098] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.754591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.777032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.777630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.777954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.778232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.779544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:14.779930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.781439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.798695 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 546/1099] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.804295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:14.844475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:14.852956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e9ab-c731-4fce-8e47-f0a0edae93dc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.886868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.887473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.887755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.888028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.896446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=75c0d1b97a94470884335f4d2843a81b, user.id=3745ccb6b9e94619a4cc77ff1191271d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:14.896446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:14.898157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:14.902654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880460-a159-493f-8d70-3969afb77756 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:14.904320 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 554/1100] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/role_assignments?user.id=3745ccb6b9e94619a4cc77ff1191271d&scope.project.id=75c0d1b97a94470884335f4d2843a81b&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:14.941931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:14.949018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:14.949018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:14.949018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:14.973197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:15.041373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.042810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.143971 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 547/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 01:00:15.149854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:15.245407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a987c-cc38-49ea-adbe-0461e2039eda None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:15.278975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:15.279587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:15.279868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:15.280143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:15.289857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.291312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:15.305952 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:15.306867 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:00:15.307739 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:15.307739 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:00:15.307739 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:15.307739 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 555/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:15.313494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:15.370534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:15.412836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8a75-c81d-4b79-a921-9054ebc62b8a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:15.446798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:15.447392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:15.447672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:15.447945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:15.448579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:15.448886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.450281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.461703 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 548/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:15.467652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:15.478670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:15.565778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9b21-71be-454d-901f-b8533dc93e60 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:15.597746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:15.598399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:15.598682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:15.598959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:15.605279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.606744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:00:15.618831 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:15.619751 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:15.620636 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 556/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:15.626047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:15.723373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae1958-3b59-4310-8a24-ac429421b99b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:15.739914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:15.756019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:15.756615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:15.760099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:15.760099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:15.760099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:15.760099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.760099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802fb2-689e-488d-9127-43974c68b8fd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.771094 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 549/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:15.777503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:15.858235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:15.891663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310e08-a629-4652-9d98-ef6d5e4fe7d1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:15.923654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:15.924243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:15.924518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:15.924788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:15.925496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] RBAC: Adding query filter params (role.id=b872065fcaf24c67b3cc38b8c7fef998, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f7e1030a5d0842f4b949a37a42ff753d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:15.925799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:15.927235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f81-f0f9-455c-b01a-426dd60c80f2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:15.932772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 557/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:15 2022] GET /identity/v3/role_assignments?user.id=f7e1030a5d0842f4b949a37a42ff753d&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=b872065fcaf24c67b3cc38b8c7fef998 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:16.962391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8f2ce-27a9-4cc5-a1ca-ef3a215f3267 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:16.962920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8f2ce-27a9-4cc5-a1ca-ef3a215f3267 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:16.962920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8f2ce-27a9-4cc5-a1ca-ef3a215f3267 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:16.964283 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 550/1107] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:16.970206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:16.970593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:16.970768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:16.989231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:16.990447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:17.055216 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 558/1108] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:17.079228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8f2ce-27a9-4cc5-a1ca-ef3a215f3267 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:17.176473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8f2ce-27a9-4cc5-a1ca-ef3a215f3267 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:17.208792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:17.209400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:17.209679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:17.210050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:17.211144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:17.212607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f1ea0-9981-465c-b066-5a5c19699016 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:17.214129 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 551/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:17.220703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:17.278395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:17.315936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6e887-32c3-48ce-b9af-8c18d5e604ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:17.350619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:17.351219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:17.351499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:17.351774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:17.352427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:17.353896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfa1f-95ab-4e63-baab-d883f684a07c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:17.444242 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 559/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 01:00:17 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:19.489861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81af7e-0328-4207-8e4a-88ea9c1718ae None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:19.490388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81af7e-0328-4207-8e4a-88ea9c1718ae None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:19.490505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81af7e-0328-4207-8e4a-88ea9c1718ae None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:19.491758 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 552/1111] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:19.496795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:19.497227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:19.497909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:19.516009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:19.517180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:19.580612 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 560/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:19.603480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81af7e-0328-4207-8e4a-88ea9c1718ae None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:19.649988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:19.702052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81af7e-0328-4207-8e4a-88ea9c1718ae None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:19.735865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:19.736472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:19.736750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:19.737022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] PATH_INFO: `/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:19.738415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] RBAC: Authorizing `identity:get_role(role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:19.739767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:19.741105 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 553/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:19 2022] GET /identity/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:19.746857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:19.793782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:19.842481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695582fc-ad8c-4709-8bf4-035ba0f01f4e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:19.874601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:19.875209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:19.875486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:19.875755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] PATH_INFO: `/v3/users/badf3e5165524e218173ab04479170ac` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:19.888471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] RBAC: Authorizing `identity:get_user(user_id=badf3e5165524e218173ab04479170ac)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:19.889927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:19.891473 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 561/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:19 2022] GET /identity/v3/users/badf3e5165524e218173ab04479170ac => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:19.897208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:19.996534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade67b-2d5a-434d-8e5f-e95cb307f6a7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:20.010139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:20.030226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:20.030822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:20.031107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:20.031381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:20.096879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:20.098388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:20.192629 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 554/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:20.198581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:20.292647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b858f2-bd7c-460c-a366-0904841027c0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:20.299498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:20.324722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:20.325434 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:20.326457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:20.326737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:20.327837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:20.329507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c63e8-9505-486b-b09f-88a213d0d0e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:20.331120 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 562/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:20 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:20.337232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:20.352576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:20.432931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759bb5-baac-4aa1-a706-c226f2237f51 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:20.464936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:20.465520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:20.465800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:20.466624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:20.467523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=75c0d1b97a94470884335f4d2843a81b, user.id=badf3e5165524e218173ab04479170ac) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:20.467836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:20.469243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4268-300b-4c5f-aebc-3182c56375ee None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:20.474385 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 555/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:20 2022] GET /identity/v3/role_assignments?user.id=badf3e5165524e218173ab04479170ac&scope.project.id=75c0d1b97a94470884335f4d2843a81b&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:22.424582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480524-801b-44ed-b88a-c1b54d74d6c3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.427601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480524-801b-44ed-b88a-c1b54d74d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.427601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480524-801b-44ed-b88a-c1b54d74d6c3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.427601 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 563/1118] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:22.431369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.431771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.431911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.449657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:22.451016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:22.514675 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 556/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:22.536580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03480524-801b-44ed-b88a-c1b54d74d6c3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:22.635277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03480524-801b-44ed-b88a-c1b54d74d6c3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:22.667746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:22.668359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.668642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.668952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] PATH_INFO: `/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.670372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] RBAC: Authorizing `identity:get_role(role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:22.671736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:22.673028 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 564/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:22 2022] GET /identity/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:22.678775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:22.689191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:22.773394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103224e-d30c-450a-bddc-e6c4e8f58fd3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:22.805572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:22.806206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.806487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.806761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] PATH_INFO: `/v3/users/badf3e5165524e218173ab04479170ac` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.807849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] RBAC: Authorizing `identity:get_user(user_id=badf3e5165524e218173ab04479170ac)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:22.809267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:22.811689 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 557/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:22 2022] GET /identity/v3/users/badf3e5165524e218173ab04479170ac => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:22.817305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:22.858975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:22.913464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8195e6-5755-44ed-9162-c222b0fc7c1c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:22.947100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:22.947650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.947929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.948203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.949302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:22.950961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753274a-026f-4d92-9b89-f70c5eab42bb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:22.952555 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 565/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:22 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:22.958681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:23.036292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:23.057964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22436b-b492-4a1d-b04f-027e3dd55c78 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:23.091380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:23.092016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:23.092296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:23.092572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b/users/badf3e5165524e218173ab04479170ac/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:23.094709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] RBAC: Authorizing `identity:create_grant(project_id=75c0d1b97a94470884335f4d2843a81b, user_id=badf3e5165524e218173ab04479170ac, role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:23.096141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f72688-7868-4a7e-8f8d-b6039e73cf2a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:23.160737 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 558/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:00:22 2022] PUT /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b/users/badf3e5165524e218173ab04479170ac/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:00:25.140401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82e49-e6b7-44cc-aa3e-a518d9361a43 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.140939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82e49-e6b7-44cc-aa3e-a518d9361a43 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.140939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82e49-e6b7-44cc-aa3e-a518d9361a43 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.142301 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 566/1124] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:25.147489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.147926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.148052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.166252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:25.167431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:25.232136 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 559/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:25.255068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82e49-e6b7-44cc-aa3e-a518d9361a43 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:25.352795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82e49-e6b7-44cc-aa3e-a518d9361a43 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:25.363647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.386266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:25.386878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.387156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.387486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] PATH_INFO: `/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.389554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] RBAC: Authorizing `identity:get_role(role_id=175cc9eeb20140e0bd2eee5e0e2c0bad)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:25.390970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:25.392261 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 567/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/roles/175cc9eeb20140e0bd2eee5e0e2c0bad => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:25.398293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:25.460817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.493645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e9e50-d3ed-442e-a8b5-95176fb579ea None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:25.527552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:25.528212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.528488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.528759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] PATH_INFO: `/v3/users/badf3e5165524e218173ab04479170ac` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.529922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] RBAC: Authorizing `identity:get_user(user_id=badf3e5165524e218173ab04479170ac)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:25.531321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:25.532871 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 560/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/users/badf3e5165524e218173ab04479170ac => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:25.538659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:25.634661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124db5-fb82-4cdd-9057-80cd6416d0a9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:25.667336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:25.667931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.668216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.668494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.712202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.733679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:25.735207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:25.830209 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 568/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:25.836095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:25.931957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761de2c-72d7-4c06-bac1-f79938cc906f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:25.964505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:25.965118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.965398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.966322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] PATH_INFO: `/v3/projects/75c0d1b97a94470884335f4d2843a81b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.967506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] RBAC: Authorizing `identity:get_project(project_id=75c0d1b97a94470884335f4d2843a81b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:25.968936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91ac7d-0f84-493b-a037-c2ca4ee123a4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:25.970630 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 561/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/projects/75c0d1b97a94470884335f4d2843a81b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:25.976834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:26.051300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:26.071419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbb8ae-62fa-447e-b433-bb5d2afd7360 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:26.104809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:26.105399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:26.105678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:26.105984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:26.106734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] RBAC: Adding query filter params (role.id=175cc9eeb20140e0bd2eee5e0e2c0bad, scope.project.id=75c0d1b97a94470884335f4d2843a81b, user.id=badf3e5165524e218173ab04479170ac) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:26.107041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:26.108453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62ad9-eb69-4896-a764-e4c9e2a50c9e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:26.114005 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 569/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/role_assignments?user.id=badf3e5165524e218173ab04479170ac&scope.project.id=75c0d1b97a94470884335f4d2843a81b&role.id=175cc9eeb20140e0bd2eee5e0e2c0bad => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:28.102110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f878d-8abc-4a6d-9c7f-f6b12c66d447 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.102649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f878d-8abc-4a6d-9c7f-f6b12c66d447 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.102649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f878d-8abc-4a6d-9c7f-f6b12c66d447 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.103989 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 562/1131] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:28.109452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.109904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.110043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.127644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:28.128811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:28.191764 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 570/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:28.214938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f878d-8abc-4a6d-9c7f-f6b12c66d447 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:28.218398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:28.313287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f878d-8abc-4a6d-9c7f-f6b12c66d447 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:28.346176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:28.346783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.347063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.347333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.348418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:28.349854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06286-85dd-41d5-9824-941eacf47329 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:28.351387 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 563/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:28.357250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:28.423377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:28.452202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57a16-d6a0-4bbf-a7c8-efad7c8d3d00 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:28.487486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:28.488071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.488348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.488617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.489250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:28.490702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bef3b-28cf-4737-ba86-ded615c56f20 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:28.602438 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 571/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 01:00:28 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:30.624573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc2ce-d209-4ee0-906d-6cb2aaa2103a None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.625128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc2ce-d209-4ee0-906d-6cb2aaa2103a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.625128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc2ce-d209-4ee0-906d-6cb2aaa2103a None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.626507 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 564/1135] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:30.631573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.631990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.632120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.650278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:30.651485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:30.714608 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 572/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:30.739225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fc2ce-d209-4ee0-906d-6cb2aaa2103a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:30.806927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:30.836163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fc2ce-d209-4ee0-906d-6cb2aaa2103a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:30.869745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:30.870384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.870668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.870946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.872107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:30.873542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8154c-8802-4b59-be29-3a6ba2723466 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:30.875192 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 565/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:30.880770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:30.934075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:30.977583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53aa3f-52fa-447a-9927-33fdd3674fc4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:31.011410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:31.012554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:31.012939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:31.013217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:31.013882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:31.015322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690576b0-eb47-4a27-8374-0d0af2397bbf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:31.145184 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 573/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 01:00:30 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:33.179224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9a6c-eb42-4fe8-9f6c-8736ad83b9b0 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.179772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9a6c-eb42-4fe8-9f6c-8736ad83b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.179772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9a6c-eb42-4fe8-9f6c-8736ad83b9b0 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.181116 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 566/1139] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:33.186925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.187304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.187471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.205250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:33.206445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:33.271904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 574/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:33.294821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d9a6c-eb42-4fe8-9f6c-8736ad83b9b0 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:33.393219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d9a6c-eb42-4fe8-9f6c-8736ad83b9b0 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:33.425893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:33.426518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.426796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.427066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.433466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:33.437758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:33.442414 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:33.444498 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:33.445616 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 567/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:33.449449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:33.489534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:33.545508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dc08-71da-4976-a276-7a8cc86dd84d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:33.579269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:33.579857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.580134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.580403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.581081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:33.581382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:33.582760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:33.590620 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 575/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:33.596407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:33.694278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93b0f-314e-491f-83cf-ca25984a0976 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:33.727469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:33.728081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.728363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.728639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] PATH_INFO: `/v3/users/d49e92a645ab45e4b6e7a42270af43a3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.741813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] RBAC: Authorizing `identity:get_user(user_id=d49e92a645ab45e4b6e7a42270af43a3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:33.743278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:33.744858 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 568/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:33 2022] GET /identity/v3/users/d49e92a645ab45e4b6e7a42270af43a3 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:33.751956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:33.853587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0eea-f4c2-4e37-87e3-c0659a555cbb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:33.855070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:33.886287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:33.886920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.887198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.887548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.951138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:33.952631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:34.050213 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 576/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:34.056125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:34.110109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:34.151411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acbd82-baf4-4387-8d08-a31c42472ada None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:34.184152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:34.184764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:34.185050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:34.185327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] PATH_INFO: `/v3/projects/1a18550fe48d4280b24ecb95041627ce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:34.186447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] RBAC: Authorizing `identity:get_project(project_id=1a18550fe48d4280b24ecb95041627ce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:34.187884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4535c-1a4c-4123-afa1-22c2524a0fdc None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:34.189519 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 569/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:34 2022] GET /identity/v3/projects/1a18550fe48d4280b24ecb95041627ce => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:34.195593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:34.197728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:34.291629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c307-b34a-408f-89ca-01e9968fc28b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:34.324127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:34.325306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:34.325582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:34.325875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:34.326589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=1a18550fe48d4280b24ecb95041627ce, user.id=d49e92a645ab45e4b6e7a42270af43a3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:34.326896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:34.328308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658608-3dc6-47d5-96e4-4640ed45d693 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:34.333820 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 577/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:34 2022] GET /identity/v3/role_assignments?user.id=d49e92a645ab45e4b6e7a42270af43a3&scope.project.id=1a18550fe48d4280b24ecb95041627ce&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:36.316028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f109f-5d84-49d2-9e75-15a91f64700f None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.316537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f109f-5d84-49d2-9e75-15a91f64700f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.316537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f109f-5d84-49d2-9e75-15a91f64700f None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.317852 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 570/1147] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:36.322847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.323259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.323395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.342202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:36.343374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:36.399803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:36.407554 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 578/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:36.429547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f109f-5d84-49d2-9e75-15a91f64700f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:36.526143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f109f-5d84-49d2-9e75-15a91f64700f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:36.548782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:36.558808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:36.559419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.559698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.559968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.569551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:36.574603 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:36.575767 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:36.576610 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 571/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:36.581979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:36.676258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e9e2-9f77-480a-a741-bc59595d5ab8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:36.709617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:36.710240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.710526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.710803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.711463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:36.711770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:36.713131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:36.720841 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 579/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:36.726558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:36.823706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a264-7e7b-4a04-8354-56c287557cf1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:36.857068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:36.857669 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.857979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.858254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] PATH_INFO: `/v3/users/d49e92a645ab45e4b6e7a42270af43a3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.859353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] RBAC: Authorizing `identity:get_user(user_id=d49e92a645ab45e4b6e7a42270af43a3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:36.860765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:36.862340 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 572/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:36 2022] GET /identity/v3/users/d49e92a645ab45e4b6e7a42270af43a3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:00:36.868048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:36.925195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:36.966658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305be89-6b4b-4e10-b1eb-7dc6c4de5582 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:37.019905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:37.019905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:37.019905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:37.019905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] PATH_INFO: `/v3/projects/1a18550fe48d4280b24ecb95041627ce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:37.020319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a18550fe48d4280b24ecb95041627ce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:37.020319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df49f5-17ef-4df4-85e6-e8e9495458c4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:37.020319 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 580/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:36 2022] GET /identity/v3/projects/1a18550fe48d4280b24ecb95041627ce => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:37.020551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:37.064280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:37.109144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9d6-d3f5-4166-b6d1-82df514727eb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:37.142073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:37.142726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:37.143009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:37.143285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] PATH_INFO: `/v3/projects/1a18550fe48d4280b24ecb95041627ce/users/d49e92a645ab45e4b6e7a42270af43a3/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:37.145176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a18550fe48d4280b24ecb95041627ce, user_id=d49e92a645ab45e4b6e7a42270af43a3, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:37.146626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e73bfc-1729-41cb-94ad-6f0cafa6be43 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:37.226425 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 573/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:00:37 2022] PUT /identity/v3/projects/1a18550fe48d4280b24ecb95041627ce/users/d49e92a645ab45e4b6e7a42270af43a3/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:00:39.206286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc434de9-8edc-4ed5-90ae-aebfa8bde587 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.206800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc434de9-8edc-4ed5-90ae-aebfa8bde587 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.206916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc434de9-8edc-4ed5-90ae-aebfa8bde587 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.208186 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 581/1154] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:39.213315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.213717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.213892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.232657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:39.233756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:39.298059 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 574/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:39.320262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc434de9-8edc-4ed5-90ae-aebfa8bde587 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:39.420722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc434de9-8edc-4ed5-90ae-aebfa8bde587 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:39.444672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:39.453408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:39.454312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.454589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.454855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.464345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:39.469538 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:39.470508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:39.471398 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:39.472157 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 582/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:39.477040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:39.518265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:39.573489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa410a0-c176-4e9b-bdfe-6ee983ec6773 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:39.607321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:39.607935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.608212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.608484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.609140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:39.609444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:39.610827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:39.618677 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 575/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:39.625034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:39.723793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c880-d6ba-42f2-b9ab-c8bc1a4c7c16 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:39.766962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:39.767575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.767855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.768128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] PATH_INFO: `/v3/users/d49e92a645ab45e4b6e7a42270af43a3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.769294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] RBAC: Authorizing `identity:get_user(user_id=d49e92a645ab45e4b6e7a42270af43a3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:39.770702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:39.772259 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 583/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:39 2022] GET /identity/v3/users/d49e92a645ab45e4b6e7a42270af43a3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:39.778573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:39.874711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9afd19-5d2f-48ef-9eba-d278792d08ab None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:39.877021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:39.908157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:39.908749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.909032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.909309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.974443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:39.975903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:40.071564 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 576/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:40.077943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:40.132402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:40.176634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fada35-a72e-4757-8c2b-e312d8d2874d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:40.210751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:40.211362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:40.211644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:40.211920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] PATH_INFO: `/v3/projects/1a18550fe48d4280b24ecb95041627ce` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:40.213029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] RBAC: Authorizing `identity:get_project(project_id=1a18550fe48d4280b24ecb95041627ce)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:40.215151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991032e4-b11e-4f23-8ddf-5fb330c800f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:40.217010 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 584/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:40 2022] GET /identity/v3/projects/1a18550fe48d4280b24ecb95041627ce => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:40.223001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:40.226025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:40.319881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5736-0b6c-4da3-be14-81df7623a2af None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:40.353254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:40.353866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:40.354153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:40.354432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:40.355751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=1a18550fe48d4280b24ecb95041627ce, user.id=d49e92a645ab45e4b6e7a42270af43a3) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:40.356278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:40.357711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35960f77-cbd3-4f3d-aff5-defbf6df9245 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:40.363325 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 577/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:40 2022] GET /identity/v3/role_assignments?user.id=d49e92a645ab45e4b6e7a42270af43a3&scope.project.id=1a18550fe48d4280b24ecb95041627ce&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:42.364596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4111-6013-4f2b-a149-b3a6af67a972 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:42.365101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4111-6013-4f2b-a149-b3a6af67a972 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:42.365210 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4111-6013-4f2b-a149-b3a6af67a972 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:42.366517 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 585/1162] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:42.372316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:42.372748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:42.372871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:42.390348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:42.391521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:42.450894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:42.456321 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 578/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:42.478006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d4111-6013-4f2b-a149-b3a6af67a972 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:42.576001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d4111-6013-4f2b-a149-b3a6af67a972 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:42.597392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:42.608708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:42.609325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:42.609574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:42.609864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:42.673726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:42.675140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:42.769370 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 586/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:42.775239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:42.869294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd1e7-f6cd-4e16-a434-66f69f717153 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:42.902145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:42.902754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:42.903036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:42.903309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:42.909688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:42.911150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-4aa9985e-31f4-4d99-9cba-ab0916b87eaf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:42.922206 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:42.923411 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:42.924522 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 579/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 01:00:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:42.929145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:42.952741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:43.027277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7eac2-b2a9-45eb-8d25-8c3e0af10a4b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:43.060541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:43.061131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:43.061411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:43.061682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:43.062343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:43.062651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:43.064005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd391c46-3db9-43eb-8fc2-5d8e36adf075 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:43.070872 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 587/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Aug 7 01:00:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:45.067847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242329e7-79c7-4ff3-88e7-49bd0ef32bbd None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:45.068332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242329e7-79c7-4ff3-88e7-49bd0ef32bbd None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:45.068421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242329e7-79c7-4ff3-88e7-49bd0ef32bbd None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:45.069721 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 580/1167] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:45.075541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0dff-20f2-4892-8062-c52e9426cf0e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:45.075951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0dff-20f2-4892-8062-c52e9426cf0e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:45.076093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0dff-20f2-4892-8062-c52e9426cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:45.094427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-abcc0dff-20f2-4892-8062-c52e9426cf0e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:45.095599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-abcc0dff-20f2-4892-8062-c52e9426cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:45.158792 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 588/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:45.181167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242329e7-79c7-4ff3-88e7-49bd0ef32bbd None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:45.238692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:45.279756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242329e7-79c7-4ff3-88e7-49bd0ef32bbd None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:45.312519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:45.313101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:45.313380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:45.313651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:45.314337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:45.315698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ddade-85af-4409-a516-de56e5399678 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:45.378994 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 581/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Sun Aug 7 01:00:45 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:47.399080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f7f1-6c61-4f68-bf6f-45a270ac3078 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.399624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f7f1-6c61-4f68-bf6f-45a270ac3078 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.399624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f7f1-6c61-4f68-bf6f-45a270ac3078 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.400974 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 589/1170] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:47.406408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.406819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.406964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.424643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:47.425851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:47.490530 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 582/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:47.514463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f7f1-6c61-4f68-bf6f-45a270ac3078 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:47.532016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:47.612676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f7f1-6c61-4f68-bf6f-45a270ac3078 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:47.645109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:47.645723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.646031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.646307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] PATH_INFO: `/v3/domains/223bce9723da45ad8b8455b1527d8e8f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.656372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] RBAC: Authorizing `identity:get_domain(domain_id=223bce9723da45ad8b8455b1527d8e8f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:47.657749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcadcb2-3ab7-4ec8-be49-11575759795a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:47.659372 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 590/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Sun Aug 7 01:00:47 2022] GET /identity/v3/domains/223bce9723da45ad8b8455b1527d8e8f => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:47.665136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:47.712371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:47.762075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b240a-ada3-4bc8-9c06-43b88072fcff None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:47.796519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:47.797096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.797376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.797647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.798317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:47.799743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6538e-a6c0-4657-9b58-6ad9eebabc90 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:47.883641 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 583/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 01:00:47 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:00:49.915245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ea4e-3643-45f0-9e61-6d6ef7f49da3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:49.915793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ea4e-3643-45f0-9e61-6d6ef7f49da3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:49.915793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ea4e-3643-45f0-9e61-6d6ef7f49da3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:49.917668 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 591/1174] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:49.922884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:49.923263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:49.923446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:49.941654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:49.942863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:50.007751 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 584/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:50.031594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ea4e-3643-45f0-9e61-6d6ef7f49da3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:50.108023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:50.130736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ea4e-3643-45f0-9e61-6d6ef7f49da3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:50.163572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:50.164185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:50.164466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:50.164739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] PATH_INFO: `/v3/domains/223bce9723da45ad8b8455b1527d8e8f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:50.165914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] RBAC: Authorizing `identity:get_domain(domain_id=223bce9723da45ad8b8455b1527d8e8f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:50.167840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c6b59-d978-4cb2-a2a2-9a7cccc5119f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:50.169364 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 592/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Sun Aug 7 01:00:50 2022] GET /identity/v3/domains/223bce9723da45ad8b8455b1527d8e8f => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:50.175132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:50.204054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:50.271379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392b95-96ba-48a7-9a8d-ae5ef999fccf None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:50.304723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:50.305320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:50.305606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:50.305908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:50.306559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:50.308368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20282792-90f7-4cca-b75f-468dc1201c66 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:50.385638 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 585/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 01:00:50 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:00:52.431247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1978-c0c1-4fa4-83ac-1185e86d3b78 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:52.431904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1978-c0c1-4fa4-83ac-1185e86d3b78 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:52.431904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1978-c0c1-4fa4-83ac-1185e86d3b78 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:52.433792 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 593/1178] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:52.438889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:52.439312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:52.439442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:52.458749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:52.459926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:52.524178 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 586/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:00:52.547065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f1978-c0c1-4fa4-83ac-1185e86d3b78 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:52.644889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f1978-c0c1-4fa4-83ac-1185e86d3b78 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:52.676642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:52.677249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:52.677530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:52.677804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:52.687937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:52.692473 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:52.693645 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:52.694795 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 594/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:52.700065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:52.717170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:52.796736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7279-ad9e-42b4-b69d-aa7488fb9046 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:52.829469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:52.830084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:52.830370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:52.830643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:52.831301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:52.831607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:52.832962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:52.840838 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 587/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:52.846561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:52.850813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:52.943026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef571d8-7423-443a-bd32-415397c9c9f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:52.975350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:52.975978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:52.976260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:52.976535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] PATH_INFO: `/v3/users/b68953e2b33047a0a561c5b1e4c360ed` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:52.990465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] RBAC: Authorizing `identity:get_user(user_id=b68953e2b33047a0a561c5b1e4c360ed)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:52.991900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:52.993535 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 595/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:52 2022] GET /identity/v3/users/b68953e2b33047a0a561c5b1e4c360ed => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:52.999990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:53.076177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:53.097277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c445f-3d46-4ad3-8c41-3224a9a33fe2 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:53.130112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:53.130696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:53.130977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:53.131252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:53.195152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:53.196527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:53.270132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:53.290751 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 588/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:53.296950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:53.357284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:53.394778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a7747-e327-4d63-8856-8aa2341bf71f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:53.426612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:53.427226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:53.427508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:53.427782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] PATH_INFO: `/v3/projects/1378f8ce288a4682a16e4e6bda51630a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:53.428883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=1378f8ce288a4682a16e4e6bda51630a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:53.430331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4b99-514f-4d5a-af68-074f7da3e4d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:53.431935 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 596/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:53 2022] GET /identity/v3/projects/1378f8ce288a4682a16e4e6bda51630a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:53.438843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:53.537752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237826fc-65c4-4b30-a2c3-b414ce07a168 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:53.570740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:53.571326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:53.571604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:53.571876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:53.572592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=1378f8ce288a4682a16e4e6bda51630a, user.id=b68953e2b33047a0a561c5b1e4c360ed) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:53.572924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:53.574384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ed747-5688-4e71-b7ac-c539db8514bd None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:53.579787 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 589/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:53 2022] GET /identity/v3/role_assignments?user.id=b68953e2b33047a0a561c5b1e4c360ed&scope.project.id=1378f8ce288a4682a16e4e6bda51630a&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:55.571617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2144-e1a5-4ce5-b1fb-5452dfab933a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:55.572172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2144-e1a5-4ce5-b1fb-5452dfab933a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:55.572172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2144-e1a5-4ce5-b1fb-5452dfab933a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:55.574154 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 597/1186] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:55.579489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:55.579881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:55.580086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:55.597617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:55.598832 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:55.632540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:55.663012 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 590/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:55.685374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2144-e1a5-4ce5-b1fb-5452dfab933a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:55.783907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2144-e1a5-4ce5-b1fb-5452dfab933a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:55.811321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:55.816811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:55.817427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:55.817708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:55.818012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:55.828656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:55.833243 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:55.834360 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:00:55.835214 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 598/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:55.841054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:55.934671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ee057-b937-487b-ba7e-f0a8137cd77a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:55.967640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:55.968224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:55.968503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:55.968775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:55.969427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:55.969729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:55.971108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:55.981888 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 591/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:55.987658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:56.085150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a078e4-f341-46c4-8882-719a181d2b18 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:56.117494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:56.118133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:56.118415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:56.118689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] PATH_INFO: `/v3/users/b68953e2b33047a0a561c5b1e4c360ed` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:56.120444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] RBAC: Authorizing `identity:get_user(user_id=b68953e2b33047a0a561c5b1e4c360ed)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:56.121882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:56.123444 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 599/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:55 2022] GET /identity/v3/users/b68953e2b33047a0a561c5b1e4c360ed => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:56.129137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:56.162739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:56.225886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442af9c-5046-4a85-81a5-39cf61b55a1a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:56.258151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:56.258762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:56.259040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:56.259312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] PATH_INFO: `/v3/projects/1378f8ce288a4682a16e4e6bda51630a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:56.260424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] RBAC: Authorizing `identity:get_project(project_id=1378f8ce288a4682a16e4e6bda51630a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:56.261879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab952-44d6-4f04-a89e-79037c0559ec None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:56.263497 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 592/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:56 2022] GET /identity/v3/projects/1378f8ce288a4682a16e4e6bda51630a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:56.269224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:56.325282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:56.365371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644259b-5073-4bba-bd3d-95ce68048118 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:56.396903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:56.397538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:56.397815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:56.398114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] PATH_INFO: `/v3/projects/1378f8ce288a4682a16e4e6bda51630a/users/b68953e2b33047a0a561c5b1e4c360ed/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:56.399974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] RBAC: Authorizing `identity:create_grant(project_id=1378f8ce288a4682a16e4e6bda51630a, user_id=b68953e2b33047a0a561c5b1e4c360ed, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:56.402089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db05441-0585-40fe-b939-fac1c78817ae None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:56.468463 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 600/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:00:56 2022] PUT /identity/v3/projects/1378f8ce288a4682a16e4e6bda51630a/users/b68953e2b33047a0a561c5b1e4c360ed/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:00:58.427963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41810da-d721-4abf-a261-52b97617f171 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:58.428515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41810da-d721-4abf-a261-52b97617f171 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:58.428515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41810da-d721-4abf-a261-52b97617f171 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:58.429901 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 593/1193] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:58.435585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:58.435994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:58.436143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:58.453971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:58.455141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:58.518234 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 601/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:00:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:00:58.541716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41810da-d721-4abf-a261-52b97617f171 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:58.640823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41810da-d721-4abf-a261-52b97617f171 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:58.642318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:58.673337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:58.673972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:58.674252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:58.674524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:58.685317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:00:58.689763 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:00:58.690895 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:00:58.692108 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 594/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:00:58.696962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:58.743370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:58.792346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe309fd-25dd-44e7-b9f3-aae0c3978426 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:58.825099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:58.825697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:58.826014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:58.826290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:58.826944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:58.827250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:58.828876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:58.836513 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 602/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:58.842548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:58.938885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac7c6-e5f3-48d9-9c6f-e29eb785a116 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:58.971117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:58.971736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:58.972022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:58.972298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] PATH_INFO: `/v3/users/b68953e2b33047a0a561c5b1e4c360ed` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:58.973411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] RBAC: Authorizing `identity:get_user(user_id=b68953e2b33047a0a561c5b1e4c360ed)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:58.974938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:58.976561 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 595/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Aug 7 01:00:58 2022] GET /identity/v3/users/b68953e2b33047a0a561c5b1e4c360ed => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:58.982776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:59.079784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af898-0a97-4b27-8880-e3ce5b6ca6ab None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:59.089505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:59.112027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:59.112617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.112899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.113177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.177523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:59.179001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:59.271967 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 603/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:00:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:59.278332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:59.308624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:59.376604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933f2e0-e1bd-400e-95e4-840de30f7691 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:59.409005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:59.409619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.409931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.410211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] PATH_INFO: `/v3/projects/1378f8ce288a4682a16e4e6bda51630a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.411320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] RBAC: Authorizing `identity:get_project(project_id=1378f8ce288a4682a16e4e6bda51630a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:59.412746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd5995-17e5-4f50-a4a4-81a8ae45152d None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:59.414388 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 596/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Aug 7 01:00:59 2022] GET /identity/v3/projects/1378f8ce288a4682a16e4e6bda51630a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:59.421292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:59.432788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:59.516196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad99c4-d463-4f77-9639-27d0f4a6217f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:59.548920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:59.549449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.549725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.550026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.550744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=1378f8ce288a4682a16e4e6bda51630a, user.id=b68953e2b33047a0a561c5b1e4c360ed) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:00:59.551050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:59.552457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28772a00-535a-4b66-9846-9213e8c22170 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:59.559058 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 604/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:00:59 2022] GET /identity/v3/role_assignments?user.id=b68953e2b33047a0a561c5b1e4c360ed&scope.project.id=1378f8ce288a4682a16e4e6bda51630a&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:01:09.404953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=51 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:09.555578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=63 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:12.348648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b204ce-1a87-4d34-981f-5b723f66e0de None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:12.349698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b204ce-1a87-4d34-981f-5b723f66e0de None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:12.349698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b204ce-1a87-4d34-981f-5b723f66e0de None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:12.351212 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 597/1201] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:12.356410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:12.356847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:12.356978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:12.375264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:12.376433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:12.442407 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 605/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:12.466758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b204ce-1a87-4d34-981f-5b723f66e0de None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:12.568812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b204ce-1a87-4d34-981f-5b723f66e0de None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:12.602522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:12.603123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:12.603405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:12.603677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:12.613936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:12.616238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:12.629987 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:12.631632 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:12.633051 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:12.633051 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:12.633051 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:12.633051 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 598/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:12.637992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:12.736031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f90e94-ae6b-401e-8fc3-0c8d969f43c0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:12.764022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:12.769729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:12.770360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:12.770646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:12.770922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:12.772337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:12.772641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:12.774028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffb417-3d10-4978-b3cf-08b401b0b6e2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:12.784838 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 606/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:12.791432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:12.844454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:12.891632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf6846-e242-4465-bf88-ee6fe513b869 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:12.924611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:12.925209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:12.925494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:12.925775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:12.926425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:12.928648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b633b-42ab-4e87-b7fb-0a4939e31a21 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:13.015130 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 599/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Aug 7 01:02:12 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:15.059519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba96149-61ec-4c13-8014-67a21dec7112 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.060056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba96149-61ec-4c13-8014-67a21dec7112 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.060056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba96149-61ec-4c13-8014-67a21dec7112 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.061446 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 607/1206] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:15.066852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022636f8-171f-4778-bcec-67f93233b940 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.067224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022636f8-171f-4778-bcec-67f93233b940 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.067411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022636f8-171f-4778-bcec-67f93233b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.086196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-022636f8-171f-4778-bcec-67f93233b940 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:15.087456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-022636f8-171f-4778-bcec-67f93233b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:15.153235 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 600/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:15.176250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba96149-61ec-4c13-8014-67a21dec7112 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:15.277065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba96149-61ec-4c13-8014-67a21dec7112 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:15.310290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:15.310908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.311189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.311460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.321458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:15.326436 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:15.327593 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:15.328582 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 608/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:15.333822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022636f8-171f-4778-bcec-67f93233b940 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:15.373287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:15.430827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022636f8-171f-4778-bcec-67f93233b940 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:15.463937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:15.464530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.464809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.465078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.465727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:15.466056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:15.467428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:15.475609 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 601/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:15.481534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:15.532245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:15.581057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc18616-8c4b-4d6f-b33f-1787ccedc3f3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:15.614650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:15.615322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.615600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.615872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.625432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:15.626921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:15.640891 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:15.642078 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:15.643506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:15.643506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:15.643506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:15.643506 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 609/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:15.648413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:15.744367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:15.747276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652810-60ab-4c5f-b6ba-b69c902744ee None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:15.779254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:15.779869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.780151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.780428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.781062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:15.781368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:15.782811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:15.794468 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 602/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:15.800187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:15.899871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174aa0-86c3-4967-955e-6d34d3178514 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:15.901348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:15.932656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:15.935219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:15.935219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:15.935219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:15.940573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:15.942050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:15.953388 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:15.954515 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:15.955610 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 610/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:15.961152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.060338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9c29-623d-4264-939f-f76703be9eee None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:16.093952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:16.094532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:16.094810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:16.095080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:16.095793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:16.096094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:16.097502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:16.114350 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 603/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:16.120749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.217777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83039fca-38a4-4878-bba2-68c4632b0d35 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:16.250665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:16.251264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:16.251547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:16.251824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:16.280192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:16.317406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:16.318985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:16.418116 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 611/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:02:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:02:16.424009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.443135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:16.519806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f303082-f4d9-4f61-8309-0abdd487d4b3 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:16.553390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:16.554034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:16.554317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:16.554590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:16.564226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:16.565658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:16.581448 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:16.582591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:16.584239 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:16.584239 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:16.584239 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:16.584239 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 604/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:16.587289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.646726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:16.683156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc550f8-cc93-4bf4-a0ec-a12da41a0a6a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:16.715405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:16.715973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:16.716248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:16.716516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:16.717144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:16.717444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:16.718826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:16.730679 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 612/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:16.736602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.806393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:16.839878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef3f-2896-4029-bc96-6b61d98fbc9e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:16.873001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:16.873610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:16.873914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:16.874187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:16.881290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:16.882732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:16.893383 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:16.895224 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:16.896392 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 605/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:02:16.900461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:16.997768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ccfe-f1dc-44fa-afb4-8da936e6c6ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:17.019475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:17.030584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:17.031176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:17.031458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:17.031730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:17.032411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:17.032715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:17.034167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d34b-e141-4ebe-9a9f-504af014ccfe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:17.045407 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 613/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:17.051893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:17.150219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1505-50cd-4fd8-9ab9-556bbbc9da03 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:17.177530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:17.183581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:17.184179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:17.184464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:17.184743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:17.185461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f23e2e7e9bb442b9a76fb6c47b35d99a) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:17.185773 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:17.187218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cac8c3-93c7-4e41-947c-b160047e934c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:17.192486 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 606/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:02:17 2022] GET /identity/v3/role_assignments?user.id=f23e2e7e9bb442b9a76fb6c47b35d99a&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:19.193847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769711d-0b68-40b4-a7ca-706d5ec65b60 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.194370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769711d-0b68-40b4-a7ca-706d5ec65b60 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.194489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769711d-0b68-40b4-a7ca-706d5ec65b60 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.195904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 614/1220] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:19.201420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.201819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.202047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.220271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:19.221437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:19.286264 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 607/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:02:19.308522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769711d-0b68-40b4-a7ca-706d5ec65b60 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:19.407816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769711d-0b68-40b4-a7ca-706d5ec65b60 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:19.440297 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:19.442041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.442041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.442041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.452062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:19.456693 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:19.457618 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:19.459273 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 615/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 01:02:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:19.464017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:19.560373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfcdc0-bbc3-458a-8714-14f59f682428 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:19.583751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:19.593906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:19.594505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.594784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.595057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.595713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:19.596019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:19.597383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:19.605205 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 608/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 01:02:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:19.611163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:19.655300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:19.711769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63fdc-b36e-47f7-8743-89ace0858bd9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:19.744489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:19.746079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.746079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.746079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.755883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:19.757315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:19.773508 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:19.774617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:19.775506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:19.775506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:19.775506 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:19.775506 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 616/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:19.780438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:19.878059 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5263e-4a59-439a-8343-305c9b352ca7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:19.911779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:19.912375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:19.912663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:19.912940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:19.913584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:19.913923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:19.915348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:19.926804 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 609/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:19.932704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.030037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:20.036710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880424-8c22-4a44-931d-bd654b8e90c6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.068855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.069501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.069785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.070082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.077105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.078574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:20.090132 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:20.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:20.092514 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 617/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:20.098474 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.146017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:20.197854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0715e1-a67f-42f3-a925-6d1e7c75779b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.231807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.232418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.232673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.232949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.233673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:20.234014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.235451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.252359 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 610/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:20.258831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.354870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4a532-00de-483d-950b-276310e5e3f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.387884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.388490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.388768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.389040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.399283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.400658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:20.414578 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:20.420098 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:20.421244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:20.421244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:20.421244 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:20.421244 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 618/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:20.422192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.526530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1c4f-105c-408e-bafa-3b63453bd9ff None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.528827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:20.559058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.559680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.559943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.560220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.560876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:20.561165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.562566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.573895 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 611/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:20.579884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.589806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:20.678071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2944e-f8a4-47af-a958-041586387dca None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.712593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.713206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.713488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.713762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.720143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.721578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:20.732826 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:20.736266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:20.737495 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 619/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:20.740124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.840703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764980-608a-4503-9dfb-0d5e79d1dc61 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:20.873817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:20.874446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:20.874730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:20.875008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:20.875702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:20.876007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:20.877437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bd1-b7fe-42e9-8d0f-884b8569f0db None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:20.889672 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 612/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:20.896141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:20.962178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:20.997153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8da8b-26e3-44a7-918e-a6530cc51984 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:21.030333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:21.031049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:21.031331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:21.031612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f23e2e7e9bb442b9a76fb6c47b35d99a/roles/96b714bff9cc4dd7be62e9191aa2e832` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:21.045184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=f23e2e7e9bb442b9a76fb6c47b35d99a, role_id=96b714bff9cc4dd7be62e9191aa2e832)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:21.046665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d201-6a6f-414a-967d-f922b8af187b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:21.169204 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 620/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:02:20 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f23e2e7e9bb442b9a76fb6c47b35d99a/roles/96b714bff9cc4dd7be62e9191aa2e832 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:23.182724 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c2e8-4b23-4f8c-97c5-c67b060d0986 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.183269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c2e8-4b23-4f8c-97c5-c67b060d0986 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.183269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6c2e8-4b23-4f8c-97c5-c67b060d0986 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.184648 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 613/1233] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:23.189802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.190286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.190403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.212779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:23.214407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:23.279200 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 621/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:23.303063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6c2e8-4b23-4f8c-97c5-c67b060d0986 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:23.328252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:23.402727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6c2e8-4b23-4f8c-97c5-c67b060d0986 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:23.437807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:23.438454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.438738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.439017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.449591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:23.454584 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:23.455663 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:23.456836 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 614/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Aug 7 01:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:23.462643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:23.508115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:23.558858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05117bf8-6ab8-4a94-adf4-92c9a494fc06 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:23.592877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:23.593470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.593746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.594046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.594696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:23.594999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:23.596361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:23.603870 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 622/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Aug 7 01:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:02:23.609732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:23.694661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:23.710753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b3535-51bf-45b6-b98c-ac6cc7f04382 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:23.743234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:23.743940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.744447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.744730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.755088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:23.757180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:23.772542 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:23.773682 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:23.774604 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:23.774604 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:23.774604 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:23.774604 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 615/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:23.779410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:23.877462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e52560-2589-4d99-90c0-d7235792fcd7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:23.886680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:23.910069 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:23.910665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:23.910946 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:23.911218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:23.911851 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:23.912155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:23.913505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:23.924610 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 623/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:23.931203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.034140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62511d0-dd5b-4654-9380-71c1f856c19b None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:24.067008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:24.067618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:24.068549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:24.068829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:24.071564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:24.076653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:24.078095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:24.088947 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:24.096553 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:24.097716 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 616/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:24.098480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.195195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208708d-8192-48d3-97b4-cc51ccda4a3a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:24.228008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:24.228597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:24.228875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:24.229146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:24.229877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:24.230183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:24.231594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:24.248235 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 624/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:24.254138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.353394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e713fc7-bd84-4382-85d4-d72efc44e0d4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:24.387546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:24.388196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:24.388483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:24.388760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:24.449797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:24.456479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:24.457967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:24.556171 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 617/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:02:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:02:24.562033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.589156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:24.658863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2c8a-8631-471c-b147-7a9b9060b722 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:24.693095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:24.693784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:24.694096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:24.694369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:24.704258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:24.705656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:24.720250 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:24.721471 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:24.722519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:24.722519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:24.722519 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:24.722519 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 625/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:24.727912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.819631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:24.825233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4348895-bfd3-435b-939d-5ce446c24579 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:24.858894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:24.859490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:24.859774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:24.860045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:24.860680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:24.860985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:24.862429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:24.874028 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 618/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:24.879552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:24.957080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:24.978461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f331-589c-42c2-94bd-e14429c39ccd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:25.012749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:25.013421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.013698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.014003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.020520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:25.022637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:25.033634 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:25.040612 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:25.041728 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 626/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:25.042409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:25.138452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166d7fc-9d09-4eee-bae1-b5437b4edd7e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:25.170649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:25.172182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.172182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.172182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.172554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:25.172729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:25.174183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f4b6-3df4-4235-a7b8-bf1d5f774117 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:25.186400 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 619/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:25.192526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:25.290024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1d6aa-c848-474a-91c4-d226410628e5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:25.327216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:25.327811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.328097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.328372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.329091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] RBAC: Adding query filter params (role.id=96b714bff9cc4dd7be62e9191aa2e832, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f23e2e7e9bb442b9a76fb6c47b35d99a) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:25.329398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:25.330837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ab988-07a5-48ad-bcf9-f121795a6056 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:25.337239 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 627/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:02:25 2022] GET /identity/v3/role_assignments?user.id=f23e2e7e9bb442b9a76fb6c47b35d99a&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=96b714bff9cc4dd7be62e9191aa2e832 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.410055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449f36-a997-4cbe-ad74-c141da2eded7 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.410607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449f36-a997-4cbe-ad74-c141da2eded7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.410607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449f36-a997-4cbe-ad74-c141da2eded7 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.413232 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 620/1247] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:27.418670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.421726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.421726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.425478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.437913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.439065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.506609 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 628/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 01:02:27.529262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e449f36-a997-4cbe-ad74-c141da2eded7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.547496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.631623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e449f36-a997-4cbe-ad74-c141da2eded7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.665305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.665897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.666196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.666558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.676489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:27.681322 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:27.682475 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:27.683600 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 621/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:27.688648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.793505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b67ce-4605-4376-8c86-e5f2288e889c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.821552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.826670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.827267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.827545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.827819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.828495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.828781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.830171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.838699 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 629/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.844491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.921341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.944093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68559c6-8f78-47f7-89d8-3b047e495fa7 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.978419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.978961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.979241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.979515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.991224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.991224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:28.005442 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:28.007345 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:28.009155 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:28.009155 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:28.009155 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:28.009155 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 622/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:28.013066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.111867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2dabf-6708-4318-9d96-742024564d7e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.144840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.145431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.146318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.146592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.147227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:28.147529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.148919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.160410 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 630/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:28.166220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.266356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee000e-c8aa-4339-8180-dd59ddc9697a None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.292458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.299940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.300547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.300827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.301100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.308317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.309737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:28.320984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:28.327235 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:28.328431 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 623/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:28.330425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.385929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.433083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca089325-ee32-4613-8b64-416e7c9140ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.467745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.468350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.468633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.468906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.469626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:28.469959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.471442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.487859 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 631/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:28.494592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.593558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1e0c-25bf-4fe3-a22c-420105b06563 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.626184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.626775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.627050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.627321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.681497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.693714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.695290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.792588 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 624/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:02:28.798544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.898834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d377-1259-40cc-8ce7-3e38fcfd1832 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.911962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.932388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.933047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.933333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.933608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.943980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.945515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:28.959928 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:28.961069 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:28.962200 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:28.962200 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:28.962200 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:28.962200 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 632/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:28.966825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.055725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:29.067138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e1ec-bde6-48b3-a064-f26adfc358e1 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.101681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.102310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.102596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.102874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.103524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:29.103832 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.105305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.117036 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 625/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:29.122836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.219196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b42f-01df-4547-b57d-84afb1ccafd4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.251143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.253633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.253633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.253633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.258673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.260107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:29.271287 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:29.272389 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:29.273518 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 633/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:29.278510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.381248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047bec-c59b-49f2-bf15-c53cf94b3b80 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.419050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.419649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.419933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.420289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.420980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:29.421290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.422755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d61b9-2428-4f38-b882-dbe48765e167 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.434871 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 626/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:29.441079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.469147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:29.541473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722900c-befc-4e44-a858-f28d638c2bf5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.573767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.574386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.574669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.574944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.575915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f23e2e7e9bb442b9a76fb6c47b35d99a) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:29.576254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.577779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dccd6-12d6-43ed-b307-dacef9a59b50 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.583721 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 634/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/role_assignments?user.id=f23e2e7e9bb442b9a76fb6c47b35d99a&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:31.571665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94abaa-6b57-4793-a968-e1e38d416e1e None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.572223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94abaa-6b57-4793-a968-e1e38d416e1e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.572223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94abaa-6b57-4793-a968-e1e38d416e1e None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.573555 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 627/1261] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:31.579466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.579879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.582687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.598172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:31.599591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:31.664247 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 635/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:31.686870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94abaa-6b57-4793-a968-e1e38d416e1e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.698229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:31.787083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94abaa-6b57-4793-a968-e1e38d416e1e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.819968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.820584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.820865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.821140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.831238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:31.836081 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:31.837147 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:31.838186 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 628/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:31.843405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.861945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:31.940404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2678-f640-4a27-b4f7-64e63835b178 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.972692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.973923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.974218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.974525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.975204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:31.975507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.976899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.985522 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 636/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:31.992250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.059081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.093525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d488b5-c8a4-48bf-98f9-1b6632d78efb None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.126397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.127064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.127300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.127576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.137162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.138652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:32.153485 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:32.154591 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:32.156048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:32.156048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:32.156048 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:32.156048 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 629/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:32.161529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.240761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.259458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b502d-4bf2-4b75-a0c8-ac50fbbcdca0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.293393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.294012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.294293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.294567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.295241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:32.295632 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.296989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.307970 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 637/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:32.313719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.414441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1d59b-a082-4b14-b95c-bdc939665fe4 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.433743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.447983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.448601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.448878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.449146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.456594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.458667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:32.469400 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:32.470501 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:32.471770 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 630/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:32.476714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.579679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7093-4f8e-4dd7-ae33-3c0ff021fb80 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.613419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.614143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.614384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.614794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.615616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:32.615957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.617378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.626444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.634772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 638/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:32.640487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.738066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e65c2-0fd2-40f8-af93-e8ec76067839 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.771019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.771625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.771902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.772175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.782240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.783670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:32.797142 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:32.799177 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:32.800274 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:32.800274 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:32.800274 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:32.800274 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 631/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:32.804070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.903867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951103-edd6-434f-88b0-579dfc627aa4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.937201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.937801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.938115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.938387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.939028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:32.939329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.940682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.952329 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 639/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:32.958332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.998903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:33.058488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83349a1e-25e5-4c50-84a9-fd56d1e62a77 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.092578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.093194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.093475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.093751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.101052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.102536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:33.113348 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:33.115270 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:33.116281 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 632/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:33.120603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.181538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:33.222486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c051-fc8c-42e9-90b9-68f4204a5355 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.254347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.255395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.255678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.255952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.256636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:33.256944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.258445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5f0b-6540-4a02-992c-6a8eeead8d91 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.270043 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 640/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:33.276674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.367556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:33.375722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f55e2-cc89-4415-9733-7488cb712c31 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.408348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.408998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.409271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.409551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] PATH_INFO: `/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f23e2e7e9bb442b9a76fb6c47b35d99a/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.411588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f874cd3a8c7840c4996026cbbc27ebc3, user_id=f23e2e7e9bb442b9a76fb6c47b35d99a, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.413009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f03f9-cfcc-4395-a7f0-3ffb5260bba7 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.517893 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 633/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Aug 7 01:02:33 2022] PUT /identity/v3/projects/f874cd3a8c7840c4996026cbbc27ebc3/users/f23e2e7e9bb442b9a76fb6c47b35d99a/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:35.500311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684025d-1943-49a7-bec3-04f44fe44a70 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:35.500858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684025d-1943-49a7-bec3-04f44fe44a70 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:35.500858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684025d-1943-49a7-bec3-04f44fe44a70 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:35.502223 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 641/1274] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:35.508326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:35.508742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:35.508912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:35.527443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:35.528623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:35.594433 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 634/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:35.618173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684025d-1943-49a7-bec3-04f44fe44a70 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:35.718816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684025d-1943-49a7-bec3-04f44fe44a70 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:35.735976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:35.752146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:35.752700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:35.752977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:35.753250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:35.763313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 01:02:35.767942 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:35.774777 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:35.775655 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 642/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Aug 7 01:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:35.776410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:35.855774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:35.873559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fef6b7-4174-4670-8c65-25f148b4551a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:35.909612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:35.910247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:35.910566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:35.910872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:35.911546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:35.911835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:35.913230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:35.921196 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 635/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Aug 7 01:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:02:35.927600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.026705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4826-4dd1-4049-9009-17dc7769a255 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:36.060721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:36.061336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:36.061614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:36.061911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:36.072335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:36.073867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:36.088459 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:36.096648 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:36.097769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:36.097769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:36.097769 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:36.097769 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 643/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:36.098114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.199152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2aa9-0d41-4667-a5a9-cad7a7ebbf1e None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:36.232351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:36.233192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:36.233291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:36.233520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:36.234178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:36.234479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:36.235873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:36.247814 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 636/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:36.253509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.283761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:36.351386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b216-b774-4efc-b07e-34c09e1930b0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:36.385408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:36.386047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:36.386326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:36.386602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:36.393453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:36.394937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:02:36.406129 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:36.407266 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:36.408548 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 644/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:36.413866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.417611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:36.511109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90220c-da50-494d-8735-7bcd6acc75a8 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:36.545928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:36.546461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:36.546745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:36.547051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:36.547772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:36.548082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:36.549501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:36.566883 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 637/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Aug 7 01:02:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:36.572839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.665288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:36.674686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e8f83-a90d-410e-84ae-89b18a0593c7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:36.708893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:36.709819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:36.710125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:36.710396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:36.786629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:36.788120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:36.878311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:36.892374 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 645/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Aug 7 01:02:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 01:02:36.899103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:36.968260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:37.006943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14884a-9a79-42b5-a7ca-468b77f2f344 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:37.040887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:37.041503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:37.041778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:37.042075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:37.052665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:37.054563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:02:37.070321 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:37.071538 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 01:02:37.072719 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:02:37.072719 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 01:02:37.072719 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:37.072719 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 638/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:37.078176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:37.179465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209d18-7828-4a23-ac3f-5fe90fe0e3e0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:37.215283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:37.216007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:37.216290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:37.216568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:37.217212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:37.217517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:37.218919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:37.230526 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 646/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Aug 7 01:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:37.237302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:37.346040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728527c-2be5-4b57-a52a-86a72f4237a6 None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:37.359651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:37.380441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:37.381063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:37.381348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:37.381625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:37.388227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:37.389651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 01:02:37.400984 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:37.402077 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: ERROR keystone.server.flask.application Aug 07 01:02:37.403170 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 639/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Aug 7 01:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:37.408081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:37.460748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:37.510294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a1219-f746-44f5-9258-1e82d2404f27 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:37.543279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:37.543872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:37.544149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:37.544418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:37.545094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:37.545395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:37.546901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465dde-4ccf-4f2b-970a-f08d1a938fe2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:37.559000 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 647/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Aug 7 01:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:37.565108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:37.664472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e83c46-fb8a-45b5-a74e-4ef73e23b33f None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:37.698648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:37.699248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:37.699534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:37.699811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:37.700796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] RBAC: Adding query filter params (role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7, scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3, user.id=f23e2e7e9bb442b9a76fb6c47b35d99a) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:37.701107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:37.702601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd708e-c1de-461a-970d-985edad9e461 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:37.709088 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 640/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Aug 7 01:02:37 2022] GET /identity/v3/role_assignments?user.id=f23e2e7e9bb442b9a76fb6c47b35d99a&scope.project.id=f874cd3a8c7840c4996026cbbc27ebc3&role.id=d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:39.748579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d7f6-82c7-49a3-ab8a-e5fec157ca7e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:39.749106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d7f6-82c7-49a3-ab8a-e5fec157ca7e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:39.749224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d7f6-82c7-49a3-ab8a-e5fec157ca7e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:39.750560 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 648/1288] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:39.756143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:39.756567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:39.756695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:39.774852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:39.776031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:39.805656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:39.842644 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 641/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:39.866292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d7f6-82c7-49a3-ab8a-e5fec157ca7e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:39.973852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d7f6-82c7-49a3-ab8a-e5fec157ca7e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:39.984736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:40.007816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:40.008370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:40.008648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:40.008918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:40.009489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:40.010969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:40.019229 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:40.021336 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:40.022617 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 649/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 01:02:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:40.027215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:40.122014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22096411-e5c9-460e-a9ea-c67e019dd424 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:40.155246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:40.155836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:40.156115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:40.156387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:40.157007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:40.157310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:40.158701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc96a71-78b8-482d-8fa0-239207c77f81 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:40.163561 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 642/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Aug 7 01:02:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:40.169344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:40.266087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dab93f-8340-4d57-9ff8-92ab51524507 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:40.298519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:40.299109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:40.299389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:40.299663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:40.300285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:40.300589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:40.302016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2360d1-5f1f-42ea-b7c4-a725e8620b90 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:40.306381 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 650/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Aug 7 01:02:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:42.307920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1945c-4d43-4ab6-8db3-61218f3052b1 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:42.308710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1945c-4d43-4ab6-8db3-61218f3052b1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:42.308710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1945c-4d43-4ab6-8db3-61218f3052b1 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:42.310427 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 643/1293] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:42.315748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77586-b5a7-4cca-9dc5-575ae0356a78 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:42.316163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77586-b5a7-4cca-9dc5-575ae0356a78 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:42.316841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77586-b5a7-4cca-9dc5-575ae0356a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:42.335388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-50b77586-b5a7-4cca-9dc5-575ae0356a78 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:42.336559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50b77586-b5a7-4cca-9dc5-575ae0356a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:42.364865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:42.401540 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 651/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:42.423992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1945c-4d43-4ab6-8db3-61218f3052b1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:42.455046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:42.525047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1945c-4d43-4ab6-8db3-61218f3052b1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:42.557766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:42.558455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:42.558694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:42.558971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:42.559609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:42.561009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16e29a-7bcd-4c02-bd5d-9ee0bf919aa4 None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:42.631071 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 644/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Aug 7 01:02:42 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:44.641323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ee8b5-3dd0-460e-903a-03d74125dae4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.641900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ee8b5-3dd0-460e-903a-03d74125dae4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.641900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ee8b5-3dd0-460e-903a-03d74125dae4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.643244 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 652/1296] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:44.648921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.649318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.649477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.667894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:44.669114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:44.741807 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 645/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:44.764104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ee8b5-3dd0-460e-903a-03d74125dae4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:44.864148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ee8b5-3dd0-460e-903a-03d74125dae4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:44.896539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:44.897086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.897366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.897637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.898242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:44.899593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:44.908002 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:44.909019 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:44.910890 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 653/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 01:02:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:44.915834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:44.933947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:45.011485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348879d9-967e-4586-a4cf-97f84d3cc0c4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:45.045372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:45.045997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.046280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.046558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.047174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:45.047474 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:45.048830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:45.053793 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 646/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Aug 7 01:02:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:45.059840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:45.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:45.160519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531202-2f3e-4fdd-af62-163b2760b8c4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:45.195314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:45.195912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.196188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.196459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.197149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] RBAC: Adding query filter params (interface=public, service_id=61e248e774c54991b8f570b56b93f901, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:45.197455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:45.198836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c23ec-e165-4446-8977-5c236560e0ba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:45.203879 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 654/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Aug 7 01:02:45 2022] GET /identity/v3/endpoints?service_id=61e248e774c54991b8f570b56b93f901&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:45.210353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:45.288824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:45.305778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb82e7-cbc0-4940-a8b5-c0df7c78de6c None admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:45.340114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:45.340706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.340985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.341259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.341871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:45.343271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107983-c3f6-4dc3-aac3-6a875cb3e7fe None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:45.349906 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 647/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Aug 7 01:02:45 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:02:47.392973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa6e3-79c3-408c-9085-96feabd91b91 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.393487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa6e3-79c3-408c-9085-96feabd91b91 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.393603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa6e3-79c3-408c-9085-96feabd91b91 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.395678 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 655/1302] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:47.400859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.401242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.401419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.419806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:47.420979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:47.487517 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 648/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:02:47.510765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaa6e3-79c3-408c-9085-96feabd91b91 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.602835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:47.609360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaa6e3-79c3-408c-9085-96feabd91b91 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.641711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.642427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.642708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.643025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.643554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.645047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:02:47.653487 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:02:47.655764 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Aug 07 01:02:47.656594 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 656/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Aug 7 01:02:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:02:47.661239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.736187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:47.758790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec39aad-75e3-4890-bffa-32ed174e49bd None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.792366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.792971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.793257 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.793533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] PATH_INFO: `/v3/services` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.794191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] RBAC: Adding query filter params (name=placement) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:47.794529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.800758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba358625-f70f-43eb-9266-8ab66f072bac None admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:47.801569 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 649/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Aug 7 01:02:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:47.807407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.904627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a99da-9ad8-4e85-b78d-923017b12fd4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.937218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.937810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.938121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.938397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.939041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.940403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3d91c-f23f-47bc-87e9-1881c6d13326 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.058858 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 657/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:57.797921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=30 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:58.054275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:44.770045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1f84-772b-4a1a-b26f-b74d83977f49 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:44.770450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1f84-772b-4a1a-b26f-b74d83977f49 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:44.770696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1f84-772b-4a1a-b26f-b74d83977f49 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:44.773455 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 650/1307] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:44.779638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dadf8-76e9-4d7a-9da5-b2ff606137b2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:44.780638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dadf8-76e9-4d7a-9da5-b2ff606137b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:44.781048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dadf8-76e9-4d7a-9da5-b2ff606137b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:44.864356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6c8dadf8-76e9-4d7a-9da5-b2ff606137b2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:44.865600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6c8dadf8-76e9-4d7a-9da5-b2ff606137b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:44.984779 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 658/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:45.039282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:45.039573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:45.039858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:45.041654 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 651/1309] 10.222.0.36 () {54 vars in 965 bytes} [Sun Aug 7 01:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:45.048022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d433c2-d280-4965-a949-aacff4ce477d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:45.051491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d433c2-d280-4965-a949-aacff4ce477d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:45.052697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d433c2-d280-4965-a949-aacff4ce477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:45.161369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-61d433c2-d280-4965-a949-aacff4ce477d None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:45.162605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-61d433c2-d280-4965-a949-aacff4ce477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:45.184279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:45.242099 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 659/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Sun Aug 7 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:45.250916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:45.252738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:45.374902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc6d0-8ab7-4200-8524-27a75a403290 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:45.453129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:45.453742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:45.454044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:45.454317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:45.455919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:45.513053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:45.571582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:45.573065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db2a8-21e6-48b7-b5ee-25325e20dd5f service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:45.595439 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 652/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:47.913631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:47.914235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:47.914235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:47.915792 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 660/1312] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:47.921312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2239-d469-4c33-acb9-79dd234cc7b7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:47.921847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2239-d469-4c33-acb9-79dd234cc7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:47.922029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2239-d469-4c33-acb9-79dd234cc7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:48.013645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-df3d2239-d469-4c33-acb9-79dd234cc7b7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:48.014910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-df3d2239-d469-4c33-acb9-79dd234cc7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:48.118700 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 653/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:48.156923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:48.158490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:48.264026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebf3af-7035-4ffd-9000-9a6d357ef1f9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:48.338081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:48.340657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:48.341291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:48.341578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:48.341871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:48.343517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:48.451196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:48.452641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04da52-c39d-424a-9a58-e7eb292ac949 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:48.471304 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 661/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:50.891614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:50.892143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:50.892258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:50.893549 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 654/1315] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:50.898800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cdb79-431c-433f-acd5-538c43bb3268 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:50.899248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cdb79-431c-433f-acd5-538c43bb3268 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:50.899430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cdb79-431c-433f-acd5-538c43bb3268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:50.964862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c83cdb79-431c-433f-acd5-538c43bb3268 None None] MFA Rules not processed for user `328b6fbc889c46839ffd48ac0a909219`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:50.966087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c83cdb79-431c-433f-acd5-538c43bb3268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:51.018976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:51.063346 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 662/1316] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:51.103354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:51.104909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:51.114557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:51.209979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219c8c-932a-4f73-b632-3389b08f69ec None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:51.281649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:51.282187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:51.282470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:51.282746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:51.284321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:51.349350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:51.404008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:51.405491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddceefd8-9000-4d7a-ae3b-70a8f12ac82c service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:51.423008 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 655/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:54.161362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48c869-0952-4a6e-9d18-86cc3b0ca98e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.161909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48c869-0952-4a6e-9d18-86cc3b0ca98e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.162001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48c869-0952-4a6e-9d18-86cc3b0ca98e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.163439 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 663/1318] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:54.168574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ab9c-edb2-447a-9b23-746e2274d6bb None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.169002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ab9c-edb2-447a-9b23-746e2274d6bb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.169107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ab9c-edb2-447a-9b23-746e2274d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.233882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-25e3ab9c-edb2-447a-9b23-746e2274d6bb None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:54.235045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-25e3ab9c-edb2-447a-9b23-746e2274d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.333143 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 656/1319] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:54.384970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.385255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.385527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.386893 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 664/1320] 10.222.0.36 () {54 vars in 965 bytes} [Sun Aug 7 01:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:54.392735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d5da-c19f-4d30-a010-704a31df14cf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.402977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d5da-c19f-4d30-a010-704a31df14cf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.402977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d5da-c19f-4d30-a010-704a31df14cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.415505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:54.469651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-89f6d5da-c19f-4d30-a010-704a31df14cf None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:54.470871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-89f6d5da-c19f-4d30-a010-704a31df14cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.544887 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 657/1321] 10.222.0.36 () {58 vars in 1062 bytes} [Sun Aug 7 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:54.554435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:54.555958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.660202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2334eb-7454-4150-a8ed-e82984e96005 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:54.731614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:54.732204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.732484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.732758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.734363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.741572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:54.840579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:54.842004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5482351-44f3-497d-ba47-56048b77a8a7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:54.859519 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 665/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:58.217575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:58.218240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:58.218240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:58.219538 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 658/1323] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:58.225491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e981523-6d64-453e-ad54-b7d65a562d9b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:58.225938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e981523-6d64-453e-ad54-b7d65a562d9b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:58.226076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e981523-6d64-453e-ad54-b7d65a562d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:58.290442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5e981523-6d64-453e-ad54-b7d65a562d9b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:58.291548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e981523-6d64-453e-ad54-b7d65a562d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:58.349258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:58.388698 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 666/1324] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:58.426005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:58.427560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:58.544730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2944e8-0159-49eb-934d-5c7569bb110d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:58.557683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:58.623775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:58.624374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:58.624651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:58.624939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:58.626528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:58.736631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:58.738845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abcedc-643d-4d8d-94b1-6a1956449b4f service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:58.758097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 659/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:00.828277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:00.828835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:00.828835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:00.830203 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 667/1326] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:00.836152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3cdb-15b7-44b0-8b92-8d997269dc5a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:00.836583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3cdb-15b7-44b0-8b92-8d997269dc5a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:00.836678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3cdb-15b7-44b0-8b92-8d997269dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:00.886382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:00.905176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2b9f3cdb-15b7-44b0-8b92-8d997269dc5a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:00.906396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2b9f3cdb-15b7-44b0-8b92-8d997269dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:01.006198 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 660/1327] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:01.041802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:01.043367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:01.145960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e403e-fdc4-426c-ba6d-9a8b4c7a988f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:01.219473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:01.219995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:01.220272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:01.220543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:01.222150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:01.239322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:01.334033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:01.335747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb05f5-931c-4a55-a800-853af3c9a263 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:01.354315 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 668/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:03.411904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:03.412588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:03.412588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:03.413857 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 661/1329] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:03.419486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f39-aa60-4f09-ab3c-aba76a0f01f6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:03.419969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f39-aa60-4f09-ab3c-aba76a0f01f6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:03.420178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f39-aa60-4f09-ab3c-aba76a0f01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:03.490599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-67412f39-aa60-4f09-ab3c-aba76a0f01f6 None None] MFA Rules not processed for user `328b6fbc889c46839ffd48ac0a909219`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:03.491895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67412f39-aa60-4f09-ab3c-aba76a0f01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:03.555038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:03.586622 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 669/1330] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:03.624914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:03.626585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:03.747172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd43f1-f78e-4068-a5cf-f8b1d2543867 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:03.774058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:03.837880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:03.837880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:03.837880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:03.837880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:03.840067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:03.975215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:03.978777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e219b2b-07ae-40ca-bdf0-b193f6e3d93e service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:03.999023 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 662/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:06.562228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:06.562768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:06.562768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:06.564116 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 670/1332] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:06.569308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb0d8-fa78-4ad6-8aec-b776851b31da None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:06.569709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb0d8-fa78-4ad6-8aec-b776851b31da None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:06.569887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb0d8-fa78-4ad6-8aec-b776851b31da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:06.632066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:06.635041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f5eeb0d8-fa78-4ad6-8aec-b776851b31da None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:06.636241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f5eeb0d8-fa78-4ad6-8aec-b776851b31da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:06.731794 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 663/1333] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:06.767683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:06.769217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:06.876379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20131-7892-42e5-b07f-4112dcfcbc80 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:06.946719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:06.947260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:06.947546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:06.947825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:06.949444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:06.977771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:07.059907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:07.061367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ee02e-bde9-435a-adb7-996a53cfd7d8 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:07.079088 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 671/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:09.116373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.116896 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.116896 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.118313 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 664/1335] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:09.123345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0581a-808b-4885-8575-1fdfcbf87bcd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.123786 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0581a-808b-4885-8575-1fdfcbf87bcd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.123906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0581a-808b-4885-8575-1fdfcbf87bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.187694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dde0581a-808b-4885-8575-1fdfcbf87bcd None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:09.188894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dde0581a-808b-4885-8575-1fdfcbf87bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:09.262351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:09.283892 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 672/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:09.324830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.326395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:09.430091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922391-16f1-4181-a467-1b50f21f3961 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.457685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:09.502651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.503241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.503519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.503791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.505388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:09.609462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.610919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd9c0-c4c3-45b3-b3ff-2e879524e572 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.629587 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 665/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:12.191318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:12.191841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:12.191955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:12.193795 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 673/1338] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:12.199023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8740e8-e031-41da-87bf-92b6235d3693 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:12.199416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8740e8-e031-41da-87bf-92b6235d3693 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:12.199584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8740e8-e031-41da-87bf-92b6235d3693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:12.264069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8d8740e8-e031-41da-87bf-92b6235d3693 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:12.265207 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8d8740e8-e031-41da-87bf-92b6235d3693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:12.273453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:12.360520 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 666/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:12.398211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:12.399846 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:12.502243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e83f-0f28-4ae2-bc4a-3c1f5ce8f34b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:12.573703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:12.574263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:12.574553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:12.574813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:12.576425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:12.611396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:12.683819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:12.685288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031575a-5803-4f46-af03-094c0d351372 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:12.705176 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 674/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:16.920834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:16.921406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:16.921406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:16.922956 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 667/1341] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:16.927943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d37d2-09e4-4124-ac19-f1d26fb6ff1f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:16.928393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d37d2-09e4-4124-ac19-f1d26fb6ff1f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:16.928519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d37d2-09e4-4124-ac19-f1d26fb6ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:16.998288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ba0d37d2-09e4-4124-ac19-f1d26fb6ff1f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:16.999581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ba0d37d2-09e4-4124-ac19-f1d26fb6ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:17.088075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:17.099044 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 675/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:17.138391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:17.139875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:17.245785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9cbe2-5b66-4fb4-b8a0-399f23d2f65e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:17.287445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:17.325851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:17.326465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:17.326744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:17.327010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:17.328605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:17.443253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:17.444843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8d690-ae4a-4911-8f09-cdf541531402 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:17.463072 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 668/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:20.404558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.405081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.405081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.406497 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 676/1344] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:20.412680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031dff-0e5e-414c-81e2-a97e7273d9bf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.413068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031dff-0e5e-414c-81e2-a97e7273d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.413246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031dff-0e5e-414c-81e2-a97e7273d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.480203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-38031dff-0e5e-414c-81e2-a97e7273d9bf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.481321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-38031dff-0e5e-414c-81e2-a97e7273d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.499841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:20.579131 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 669/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.618661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.620201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.722307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd0e0-c816-43a9-9875-c70efadcc959 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.796494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.797035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.797308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.797573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.799182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.842449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:20.913112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.914619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a3ed-01b3-463c-8dba-1dc3f16d2f9c service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.934771 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 677/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:25.171132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.171657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.171750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.173103 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 670/1347] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:25.178872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723937c-d877-4545-817f-7371bcff2cf6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.179336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723937c-d877-4545-817f-7371bcff2cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.179602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723937c-d877-4545-817f-7371bcff2cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.249537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2723937c-d877-4545-817f-7371bcff2cf6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:25.250795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2723937c-d877-4545-817f-7371bcff2cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.350125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.352736 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 678/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:25.391986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.393591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.506142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82509-cfaa-47b7-aa4d-2e8492ba66ed None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.554185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.581711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.582454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.583286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.583731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.585953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.706576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.708126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a517bd3-10ff-4b04-86c4-3af958a2a633 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.726374 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 671/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:30.732625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591447d3-fb08-474f-86f2-f9acdb59d627 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.733118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591447d3-fb08-474f-86f2-f9acdb59d627 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.733118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591447d3-fb08-474f-86f2-f9acdb59d627 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.736833 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 679/1350] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:30.744076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e5ff-ac70-458c-8c46-44988746bcc2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.744881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e5ff-ac70-458c-8c46-44988746bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.745299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e5ff-ac70-458c-8c46-44988746bcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.848167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ae64e5ff-ac70-458c-8c46-44988746bcc2 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:30.850639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ae64e5ff-ac70-458c-8c46-44988746bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.872933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:31.005022 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 672/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.041094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caab2-e3f9-4cc1-bbd9-4bd5581e1973 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.041675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caab2-e3f9-4cc1-bbd9-4bd5581e1973 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.041675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caab2-e3f9-4cc1-bbd9-4bd5581e1973 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.044251 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 680/1352] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:35.052125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cee70-ec40-4742-b4fd-c221a62a5853 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.052925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cee70-ec40-4742-b4fd-c221a62a5853 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.053317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cee70-ec40-4742-b4fd-c221a62a5853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.134739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e98cee70-ec40-4742-b4fd-c221a62a5853 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:35.135938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e98cee70-ec40-4742-b4fd-c221a62a5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.212210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.248631 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 673/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:36.740748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b456eb7-339d-4e82-b903-2de01a4e9a63 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.741383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b456eb7-339d-4e82-b903-2de01a4e9a63 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.741383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b456eb7-339d-4e82-b903-2de01a4e9a63 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.742644 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 681/1354] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:36.747643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592b87-8ae6-4d72-be9a-2170d5b729a0 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.748081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592b87-8ae6-4d72-be9a-2170d5b729a0 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.748321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592b87-8ae6-4d72-be9a-2170d5b729a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.827185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2e592b87-8ae6-4d72-be9a-2170d5b729a0 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:36.828401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2e592b87-8ae6-4d72-be9a-2170d5b729a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.935619 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 674/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:40.350135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c41fb-3e3d-46a0-a9ac-9ec4f48a696d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.350603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c41fb-3e3d-46a0-a9ac-9ec4f48a696d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.350705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c41fb-3e3d-46a0-a9ac-9ec4f48a696d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.352212 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 682/1356] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:40.358450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f05e-6201-4c6c-904c-7255878b177d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.359375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f05e-6201-4c6c-904c-7255878b177d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.360075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f05e-6201-4c6c-904c-7255878b177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.400013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:40.438370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e556f05e-6201-4c6c-904c-7255878b177d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:40.439599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e556f05e-6201-4c6c-904c-7255878b177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:40.557957 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 675/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:40.615383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.616132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.616614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.618898 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 683/1358] 10.222.0.36 () {54 vars in 962 bytes} [Sun Aug 7 01:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:40.626710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180bfe-9508-43ed-ae2c-57efa1509304 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.627443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180bfe-9508-43ed-ae2c-57efa1509304 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.627443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180bfe-9508-43ed-ae2c-57efa1509304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.712407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-94180bfe-9508-43ed-ae2c-57efa1509304 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:40.713785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-94180bfe-9508-43ed-ae2c-57efa1509304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:40.770558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:40.841127 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 676/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Aug 7 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:40.849871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:40.851868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:41.024713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e3cfe-9055-42c7-90b9-8f6ae95b0355 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:41.102142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:41.147223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:41.147886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:41.148167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:41.148439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:41.150088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:41.249797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:41.251456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a12d3-abed-464e-ab9e-28bf40dc8ef8 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:41.274010 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 684/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:43.634983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:43.635539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:43.635539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:43.637237 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 677/1361] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:43.643243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd830-a98a-4380-8438-01af14ea3a58 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:43.644755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd830-a98a-4380-8438-01af14ea3a58 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:43.645325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd830-a98a-4380-8438-01af14ea3a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:43.721388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e4ecd830-a98a-4380-8438-01af14ea3a58 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:43.722551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e4ecd830-a98a-4380-8438-01af14ea3a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:43.764209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:43.830949 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 685/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:43.875704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:43.877401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:44.049140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9adc30-a9cf-4075-bd0b-1b5ac8456fb3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:44.060357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.181354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:44.181985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:44.182268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:44.182543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:44.184156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:44.277194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:44.278837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ccbe-5431-4fba-80ed-e609a97ee114 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:44.297016 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 678/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:46.769640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3271-1ebf-4e4a-8d2c-e6503b6a9788 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.770296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3271-1ebf-4e4a-8d2c-e6503b6a9788 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.770296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3271-1ebf-4e4a-8d2c-e6503b6a9788 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.771701 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 686/1364] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:46.777246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9394d-7c25-42d7-85d2-d23b565e33e2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.777721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9394d-7c25-42d7-85d2-d23b565e33e2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.778037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9394d-7c25-42d7-85d2-d23b565e33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.796155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:46.857780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-77a9394d-7c25-42d7-85d2-d23b565e33e2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:46.859164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-77a9394d-7c25-42d7-85d2-d23b565e33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:46.964942 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 679/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:47.009821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.010537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.011095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.013303 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 687/1366] 10.222.0.36 () {54 vars in 962 bytes} [Sun Aug 7 01:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:47.018251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c0-e2fa-4fb7-8421-90d7b1561110 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.018541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c0-e2fa-4fb7-8421-90d7b1561110 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.018814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c0-e2fa-4fb7-8421-90d7b1561110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.226400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-dc5265c0-e2fa-4fb7-8421-90d7b1561110 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:47.227567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-dc5265c0-e2fa-4fb7-8421-90d7b1561110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:47.264239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:47.352067 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 680/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Aug 7 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:47.360042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.361538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:47.519589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f53cd-6cbf-4f66-8233-433e01e4623f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.543375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:47.647528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.648237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.648518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.648787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.650421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:47.751160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.752789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5329bec-e98f-4b89-bf95-6e4323eb412b service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.773944 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 688/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:48.647588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3aebc-6801-40c0-8b2f-4090d7dc4546 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.648122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3aebc-6801-40c0-8b2f-4090d7dc4546 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.648122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3aebc-6801-40c0-8b2f-4090d7dc4546 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.649561 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 681/1369] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:09:48.654679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388049fd-9914-41fc-aad3-d401e9ed5fa1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.654976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388049fd-9914-41fc-aad3-d401e9ed5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.655257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388049fd-9914-41fc-aad3-d401e9ed5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.689032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:48.728236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-388049fd-9914-41fc-aad3-d401e9ed5fa1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:48.729797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-388049fd-9914-41fc-aad3-d401e9ed5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.836048 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 689/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:49.182524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.182524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.182524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.182524 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 682/1371] 10.222.0.36 () {54 vars in 964 bytes} [Sun Aug 7 01:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:49.187688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51239e1-2cc7-4274-b59b-b37e8b123da1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.187688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51239e1-2cc7-4274-b59b-b37e8b123da1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.187688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51239e1-2cc7-4274-b59b-b37e8b123da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.264005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e51239e1-2cc7-4274-b59b-b37e8b123da1 None None] MFA Rules not processed for user `5e19c7f04deb4b04b4c2d98ca7323b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:49.265145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e51239e1-2cc7-4274-b59b-b37e8b123da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.314298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:49.345870 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 690/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Sun Aug 7 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:49.353954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.355550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.469557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eba89e-b0ba-412e-9947-311a4a3afcc1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.513078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:49.549005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.549509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.549790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.550305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.551799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.673855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.675328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499c2b-823e-4b87-a1fb-30df32cf0596 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.693453 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 683/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:49.987233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.987700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.987931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.990211 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 691/1374] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:49.994975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce81e-3807-433b-b000-a869422d3f46 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.995260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce81e-3807-433b-b000-a869422d3f46 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.995513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce81e-3807-433b-b000-a869422d3f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.071994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8a3ce81e-3807-433b-b000-a869422d3f46 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:50.073346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8a3ce81e-3807-433b-b000-a869422d3f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.095537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:50.171811 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 684/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.222734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:50.224250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.372106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6cd7-0812-45f2-9be2-9c7cc3a1d02d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:50.424411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:50.484311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:50.484912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.485196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.485473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.487102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.576768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:50.578469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f0cc6-dcfa-46e8-8e4d-c2475c8e0a65 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:50.597575 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 692/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:52.780245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.781222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.781737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.783452 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 685/1377] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:52.788862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0c-034f-40e8-b11a-42e241566b5d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.789305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0c-034f-40e8-b11a-42e241566b5d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.789420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0c-034f-40e8-b11a-42e241566b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.866494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9b2cbc0c-034f-40e8-b11a-42e241566b5d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:52.867737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9b2cbc0c-034f-40e8-b11a-42e241566b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.876519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:52.984113 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 693/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:53.028698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.030331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:53.179170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2b8e-780c-4eb4-92cf-6930291a35ea None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.182852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:53.320759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.321879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.322380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.322887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.325185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:53.432914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.435214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb559bc-4498-4e2b-ba81-d9c517387281 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.455640 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 686/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:55.616473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.617003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.617003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.618554 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 694/1380] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:55.623498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb755f-88ac-43c4-978a-6544a1a6033c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.623882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb755f-88ac-43c4-978a-6544a1a6033c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.624065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb755f-88ac-43c4-978a-6544a1a6033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.635519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.695354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c8cb755f-88ac-43c4-978a-6544a1a6033c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:55.696556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c8cb755f-88ac-43c4-978a-6544a1a6033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.807512 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 687/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:55.852074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.853803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.015827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:56.026943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bf2dc-58d0-4bd5-b5b4-666d24d336e9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.156540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.157146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.157428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.157702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.159908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.268739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.270492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174550a7-734a-436c-b616-0cd6ccb0f80e service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.281338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:56.290683 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 695/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:58.521888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.522456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.522456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.523784 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 688/1383] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:09:58.529165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20e5c-b6a0-4a80-adf6-534250cb366e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.529597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20e5c-b6a0-4a80-adf6-534250cb366e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.529727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20e5c-b6a0-4a80-adf6-534250cb366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.610554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dfc20e5c-b6a0-4a80-adf6-534250cb366e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:58.611762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dfc20e5c-b6a0-4a80-adf6-534250cb366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.712122 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 696/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:58.759478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:58.761014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.848228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:58.910351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5fe1-bbc5-4991-a821-b6403db17cf1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.030193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.030792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.031069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.031341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.032912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.082413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.124231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.125854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d5a0b-f7fa-4463-8c70-f8b0f00ef101 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.144632 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 689/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:10:01.402905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.403438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.403624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.405357 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 697/1386] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:01.412662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4d37-ca6f-4880-8c8e-dc7e544b0754 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.413148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4d37-ca6f-4880-8c8e-dc7e544b0754 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.413240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4d37-ca6f-4880-8c8e-dc7e544b0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.490787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ad3b4d37-ca6f-4880-8c8e-dc7e544b0754 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:01.492247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ad3b4d37-ca6f-4880-8c8e-dc7e544b0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.599617 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 690/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:01.646299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.648577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.743336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:01.828054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36973444-8f83-4a97-9c69-cf7e8b596411 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.952419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.953398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.953765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.954156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.956949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.005873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.071911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.074172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096bd18-bd61-43b4-99bf-1cc321271710 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.098149 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 698/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:04.341539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.342076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.342076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.343408 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 691/1389] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:04.349353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49a59-ac01-4937-be40-933b03ed507c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.349787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49a59-ac01-4937-be40-933b03ed507c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.350070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49a59-ac01-4937-be40-933b03ed507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.418251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fda49a59-ac01-4937-be40-933b03ed507c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:04.419470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fda49a59-ac01-4937-be40-933b03ed507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.514071 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 699/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:04.558583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.560096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.592348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:04.710242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5fa9c-9e35-4c4d-9788-a6e80fc0c49c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.816518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:04.828244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.828843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.829121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.829395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.831226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.921285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.922931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34432d6a-469f-407d-a0cb-01f4150baae7 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.942458 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 692/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:05.113963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccea0-6cae-4e77-993a-7e027e4c4da2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.114279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccea0-6cae-4e77-993a-7e027e4c4da2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.114553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ccea0-6cae-4e77-993a-7e027e4c4da2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.115895 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 700/1392] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:05.120991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a276bc-915f-47ad-ba02-65229fbe58b2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.121278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a276bc-915f-47ad-ba02-65229fbe58b2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.121550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a276bc-915f-47ad-ba02-65229fbe58b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.195994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c3a276bc-915f-47ad-ba02-65229fbe58b2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:05.197293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c3a276bc-915f-47ad-ba02-65229fbe58b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.263024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.304794 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 693/1393] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:05.360961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.373413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.373413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.373413 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 701/1394] 10.222.0.36 () {54 vars in 966 bytes} [Sun Aug 7 01:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:05.373746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470582fd-a852-4d79-b970-472d3ec8d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.373746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470582fd-a852-4d79-b970-472d3ec8d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.373746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470582fd-a852-4d79-b970-472d3ec8d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.446164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-470582fd-a852-4d79-b970-472d3ec8d5f6 None None] MFA Rules not processed for user `37ad903b3fcf4e1f90c6c8d2c716d3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:05.447354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-470582fd-a852-4d79-b970-472d3ec8d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.523721 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 694/1395] 10.222.0.36 () {58 vars in 1063 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:05.531290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.532883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.546512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.636252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c084-5eaf-449e-96a0-5d86b6894208 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.709090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.709683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.709991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.710264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.711845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.778916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.835027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.837031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64261b1-08ed-4326-a229-6908849b970e service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.863155 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 702/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:06.741967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034777dd-61ab-4fe4-b96a-0d0661313e42 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.742449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034777dd-61ab-4fe4-b96a-0d0661313e42 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.742536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034777dd-61ab-4fe4-b96a-0d0661313e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.812403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-034777dd-61ab-4fe4-b96a-0d0661313e42 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:06.813596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-034777dd-61ab-4fe4-b96a-0d0661313e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:06.822712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:06.903495 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 695/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:06.950922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.951398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.951490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.952847 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 703/1398] 10.222.0.36 () {54 vars in 943 bytes} [Sun Aug 7 01:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:06.959282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec9e7b-428d-4842-b1a8-6a04bf2fdde4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.959601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec9e7b-428d-4842-b1a8-6a04bf2fdde4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.959874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec9e7b-428d-4842-b1a8-6a04bf2fdde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.036150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5bec9e7b-428d-4842-b1a8-6a04bf2fdde4 None None] MFA Rules not processed for user `9deb5a597756481c89061d48e6632961`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:07.037348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5bec9e7b-428d-4842-b1a8-6a04bf2fdde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.121305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.144497 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 696/1399] 10.222.0.36 () {58 vars in 1040 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:07.154107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:07.154941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fa61-0c2c-4a26-8e2a-42c1830c6c89 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.155229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fa61-0c2c-4a26-8e2a-42c1830c6c89 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.155507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fa61-0c2c-4a26-8e2a-42c1830c6c89 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.155614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.156973 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 697/1400] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:07.161886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.162184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.162493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.229809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:07.231165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.293793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591840-3af0-43d1-ad0a-5bbeeb8b0d7a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:07.329578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.334059 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 698/1401] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:07.375403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:07.377771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.400548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.401186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.401462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.401736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.403439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.441970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.487609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.489327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769209-4f59-4cb9-b094-2e010078f73c service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.490969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886c3a0-b26d-4070-bfe3-37d96bd5d61f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:07.497348 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 704/1402] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:10:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:07.605530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.606156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.606438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.606711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.608299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.666032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.696104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.697945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3021-688f-4439-9ca5-f3e60926912a service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.716511 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 699/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:09.971646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:09.972264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:09.972487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:09.979512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed93-8b35-44a6-829e-810971042025 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:09.980002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed93-8b35-44a6-829e-810971042025 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:09.980085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ed93-8b35-44a6-829e-810971042025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:09.984576 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 705/1404] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:10.051776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9fd5ed93-8b35-44a6-829e-810971042025 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:10.053007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9fd5ed93-8b35-44a6-829e-810971042025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:10.158929 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 700/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:10.204130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:10.205965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:10.292918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:10.373872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fedc1-709f-4fb6-9eb7-e77b8ab989df None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:10.499179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:10.499906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:10.500193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:10.500468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:10.502897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:10.536934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:10.607237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:10.609713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bbd1f-09b4-4618-8e03-7f1e94513f48 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:10.636382 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 706/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:12.824641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.825224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.825224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.826884 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 701/1407] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:12.832276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3095c4-049f-4cf1-bf25-ab0b12a39394 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.832706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3095c4-049f-4cf1-bf25-ab0b12a39394 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.832858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3095c4-049f-4cf1-bf25-ab0b12a39394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.903667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2d3095c4-049f-4cf1-bf25-ab0b12a39394 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:12.904905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2d3095c4-049f-4cf1-bf25-ab0b12a39394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.016960 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 707/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:13.062907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.065007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.105217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:13.227637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654010a3-ceac-4005-8250-42ff772105e9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.350135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:13.355369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.359178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.359178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.359178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.359178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.464662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.466346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980b62-9b6f-41de-9154-4e5468269ea9 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.488643 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 702/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:10:23.015337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:23.485463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=47 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:31.133001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee90d-6c8e-45e0-887b-0510da941cb3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.133584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee90d-6c8e-45e0-887b-0510da941cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.133584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee90d-6c8e-45e0-887b-0510da941cb3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.134928 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 708/1410] 10.222.0.36 () {54 vars in 918 bytes} [Sun Aug 7 01:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:31.140026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5e3f-8fea-49d0-b294-4a4ff095b370 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.140472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5e3f-8fea-49d0-b294-4a4ff095b370 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.140586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5e3f-8fea-49d0-b294-4a4ff095b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.217789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8b5b5e3f-8fea-49d0-b294-4a4ff095b370 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:31.219072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8b5b5e3f-8fea-49d0-b294-4a4ff095b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.324866 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 703/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:31.339713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711b78-91f9-4f4b-839f-35ad0eb787ca None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.340029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711b78-91f9-4f4b-839f-35ad0eb787ca None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.340304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711b78-91f9-4f4b-839f-35ad0eb787ca None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.341614 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 709/1412] 10.222.0.36 () {54 vars in 918 bytes} [Sun Aug 7 01:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:31.346776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09999a0-d518-496e-99cf-e70c0d2702e5 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.347089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09999a0-d518-496e-99cf-e70c0d2702e5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.347391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09999a0-d518-496e-99cf-e70c0d2702e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.418916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:31.421898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a09999a0-d518-496e-99cf-e70c0d2702e5 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:31.423095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a09999a0-d518-496e-99cf-e70c0d2702e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.539148 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 704/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:34.011437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.011955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.012082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.013300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:34.018637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd9d9-006e-4899-aaba-e2c603f7544d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.019075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd9d9-006e-4899-aaba-e2c603f7544d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.019180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd9d9-006e-4899-aaba-e2c603f7544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.087571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-bb3cd9d9-006e-4899-aaba-e2c603f7544d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:34.088780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bb3cd9d9-006e-4899-aaba-e2c603f7544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.144233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:34.185918 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:34.229222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.230693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.375523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdd2b7-2b42-4eec-8503-826754f9d70f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.446465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:34.485587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.486149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.486968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.487237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.488817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.573726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.575369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454c73-c5da-408f-a962-d817554a5c28 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.593363 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 711/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:35.487253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.487820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.487820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.489187 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:35.494305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b23-5a1e-43c1-b4ca-a124e5ed0fb9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.494740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b23-5a1e-43c1-b4ca-a124e5ed0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.494838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84677b23-5a1e-43c1-b4ca-a124e5ed0fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.568566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-84677b23-5a1e-43c1-b4ca-a124e5ed0fb9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:35.569760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-84677b23-5a1e-43c1-b4ca-a124e5ed0fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.596450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:35.664631 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:35.812356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.813801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.958019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343eca2-c84b-41df-aa85-3ef9ee2dc9f4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.999213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:36.072117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:36.072653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:36.072945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:36.073225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:36.074862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:36.161328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:36.162952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49bf94-19ea-4eff-81cc-a7fe6389c556 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:36.181062 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 707/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:37.069307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:37.069862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:37.069862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:37.071252 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:37.076153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53bdd-d513-4ae7-b212-0a32900467f6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:37.076589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53bdd-d513-4ae7-b212-0a32900467f6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:37.076711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53bdd-d513-4ae7-b212-0a32900467f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:37.131919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:37.153284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0fe53bdd-d513-4ae7-b212-0a32900467f6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:37.154515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0fe53bdd-d513-4ae7-b212-0a32900467f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.249031 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:37.400720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:37.402293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.543666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd842-e56d-44c9-b356-0701bdb31abf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:37.555806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:37.655018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:37.655612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:37.655893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:37.656162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:37.657740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.745649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:37.747286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d871-e12f-4152-882e-9791126fedbb service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:37.764887 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 714/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:38.627736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.628346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.628346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.629663 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:38.634551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc98f-0131-4222-8913-d3f577b9f363 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.634974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc98f-0131-4222-8913-d3f577b9f363 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.635114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc98f-0131-4222-8913-d3f577b9f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.654785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:38.712006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-895cc98f-0131-4222-8913-d3f577b9f363 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:38.713239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-895cc98f-0131-4222-8913-d3f577b9f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:38.805917 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:38.956671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:38.958180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.069657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:39.105615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389fdc-421c-4f77-a0c7-d94cacdf7fe2 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.219371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.219893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.220173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.220529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.222199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.296422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:39.310292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.311932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b241e3-e563-4355-8d8d-9514579a0818 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.330298 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 710/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:40.202076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.202673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.202673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.203954 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:40.209199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d06ab-c7e6-4512-8bff-3235b5fd8caf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.209637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d06ab-c7e6-4512-8bff-3235b5fd8caf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.209745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d06ab-c7e6-4512-8bff-3235b5fd8caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.285001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-975d06ab-c7e6-4512-8bff-3235b5fd8caf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:40.286156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-975d06ab-c7e6-4512-8bff-3235b5fd8caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.382264 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.532462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.534797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.617291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:40.678626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f78c-45f1-49a0-863a-419e5b8b3325 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.788700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.789298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.789574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.789869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.791459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.837863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:40.878295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.879842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd348e6-a046-4d95-81ef-4bdffc280a02 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.898484 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 717/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:41.757780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.758355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.758355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.759686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:41.764754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5667-c3e6-4c35-9077-83212c78f4c8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.765176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5667-c3e6-4c35-9077-83212c78f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.765287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5667-c3e6-4c35-9077-83212c78f4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.840483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e52d5667-c3e6-4c35-9077-83212c78f4c8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:41.841672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e52d5667-c3e6-4c35-9077-83212c78f4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:41.935577 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:42.087089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.088528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:42.136550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:42.231785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f574-c000-4a89-976f-db610a75bd4e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.341404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.342033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.342314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.342589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.344176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:42.351205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:42.433700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.435327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b261e9f-06b1-4f58-9e5b-27f8deb91e3a service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.455445 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 713/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:43.302977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.303503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.303503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.304821 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:43.309890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572ee9-cab0-401c-a0b5-d9aeafe693a7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.310317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572ee9-cab0-401c-a0b5-d9aeafe693a7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.310447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572ee9-cab0-401c-a0b5-d9aeafe693a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.385586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-94572ee9-cab0-401c-a0b5-d9aeafe693a7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:43.386823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-94572ee9-cab0-401c-a0b5-d9aeafe693a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.454041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:43.484470 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:43.638025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.639569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.657416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:43.789733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c62260-450f-4bf5-8590-edcb1e6aae65 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.879670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:43.905880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.906406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.906684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.906956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.909384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.007277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:44.008889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb79fe-58ca-4f1d-a7d3-227b868e8edc service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:44.027749 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 720/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:44.966576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.967155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.967155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.968510 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:44.973490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5d80-c94a-4d0a-9d92-034e48e50fe8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.973936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5d80-c94a-4d0a-9d92-034e48e50fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.974139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5d80-c94a-4d0a-9d92-034e48e50fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.049921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-27cd5d80-c94a-4d0a-9d92-034e48e50fe8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:45.051065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-27cd5d80-c94a-4d0a-9d92-034e48e50fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.093967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:45.149191 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:45.301852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:45.303365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.446696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a40b2-b2b5-4b57-a4c3-39679abc81e1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:45.500533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:45.558070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:45.558602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.558883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.559159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.560748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.649451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:45.651081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064bd10-480c-432d-8c31-c663afb1c8a6 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:45.668426 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 716/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:46.515995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.516558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.516558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.518698 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:46.523698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc419-0bee-493c-9419-0a543ddacdab None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.524121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc419-0bee-493c-9419-0a543ddacdab None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.524291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc419-0bee-493c-9419-0a543ddacdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.601982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d9ffc419-0bee-493c-9419-0a543ddacdab None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:46.603188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d9ffc419-0bee-493c-9419-0a543ddacdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.605199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:46.698985 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:46.852553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:46.854231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:47.000633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e925729-2c92-415e-9704-cc93f8a62b55 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.027106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:47.112782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.113392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.113673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.113994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.115595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:47.202187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.203802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d587-aa07-4884-b8d2-8c0e987b3e41 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.222169 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 723/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:49.113435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.113983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.114100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.115361 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:49.120600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08cd77-3b84-4116-b8ff-d524ea209e09 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.121017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08cd77-3b84-4116-b8ff-d524ea209e09 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.121151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08cd77-3b84-4116-b8ff-d524ea209e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.163641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:49.188066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3c08cd77-3b84-4116-b8ff-d524ea209e09 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:49.189780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3c08cd77-3b84-4116-b8ff-d524ea209e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.285214 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:49.324033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:49.325569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.428658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae863-7c23-494a-b815-2dad73ff2eb7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:49.461735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:49.504151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:49.504827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.505111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.505386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.507015 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.616172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:49.617649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844dee6-1358-47b4-a030-ff22a2541813 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:49.637327 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 719/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:51.782022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:51.783219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:51.783219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:51.784410 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:51.789883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2d41-4608-4c1e-b0d3-50cda50a298f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:51.790312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2d41-4608-4c1e-b0d3-50cda50a298f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:51.790447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c2d41-4608-4c1e-b0d3-50cda50a298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:51.856421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8b5c2d41-4608-4c1e-b0d3-50cda50a298f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:51.857630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8b5c2d41-4608-4c1e-b0d3-50cda50a298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.870177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:51.952846 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:51.992041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:51.993587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:52.098405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7b8e-046f-429a-89e8-643a86f68f23 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:52.110107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:52.170458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:52.171061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:52.171346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:52.171624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:52.173458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:52.279390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:52.280836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa68ec-930e-43d7-a4ea-406bdac4c3e9 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:52.298583 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 726/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:54.640223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.640737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.640737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.642836 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:54.648021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708dd62-7fd2-4b7a-9af2-36584e586739 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.648411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708dd62-7fd2-4b7a-9af2-36584e586739 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.648578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708dd62-7fd2-4b7a-9af2-36584e586739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.695530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:54.713373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5708dd62-7fd2-4b7a-9af2-36584e586739 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:54.714617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5708dd62-7fd2-4b7a-9af2-36584e586739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:54.930417 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:54.969295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.971430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.072647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a03ac-6ac9-4c8b-a091-e2e62a02133a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.112944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:55.146290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.146895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.147176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.147452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.149037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.259830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:55.261217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65a0c4-4416-4e44-b58d-e2add99f6a68 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:55.279949 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 722/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:57.423257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.423810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.423810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.425136 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:57.430289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ddab0-f82d-466a-a38d-360d04b4d21f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.430664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ddab0-f82d-466a-a38d-360d04b4d21f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.430852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ddab0-f82d-466a-a38d-360d04b4d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.495911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cd4ddab0-f82d-466a-a38d-360d04b4d21f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:57.497118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cd4ddab0-f82d-466a-a38d-360d04b4d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:57.517358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:57.592307 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:57.632760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:57.634342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:57.737232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c0c5-ff86-467a-88fd-5729d74bd3e7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:57.756338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:57.809040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:57.809658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.809964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.810235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.811812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:57.917561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:57.919050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fa7c5-8c20-4bfe-a1e3-49e91972ee37 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:57.937110 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 729/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:00.089561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2125-2983-47c3-8323-888959fe9482 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.090164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2125-2983-47c3-8323-888959fe9482 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.090164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2125-2983-47c3-8323-888959fe9482 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.091486 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:00.097375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff84c2-3237-4fd6-9d91-a6c1a54c02b3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.097781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff84c2-3237-4fd6-9d91-a6c1a54c02b3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.097954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff84c2-3237-4fd6-9d91-a6c1a54c02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.159887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:00.162811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2dff84c2-3237-4fd6-9d91-a6c1a54c02b3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:00.164020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2dff84c2-3237-4fd6-9d91-a6c1a54c02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.260946 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:00.300488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2125-2983-47c3-8323-888959fe9482 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:00.302070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-797b2125-2983-47c3-8323-888959fe9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.407835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2125-2983-47c3-8323-888959fe9482 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:00.461644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:00.485716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:00.486341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.486623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.486916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.488482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.600658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:00.602147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bedf3e-a145-4363-a8f2-dc53791b5fcf service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:00.621138 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 725/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:02.683991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.684534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.684534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.685890 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:02.691723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa6fe-3eb8-4648-b788-ab3047443fd9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.692189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa6fe-3eb8-4648-b788-ab3047443fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.692337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa6fe-3eb8-4648-b788-ab3047443fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.759097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5fdaa6fe-3eb8-4648-b788-ab3047443fd9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:02.760325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5fdaa6fe-3eb8-4648-b788-ab3047443fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.789192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.856011 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:02.895056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:02.896604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.997477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b03ad-d27b-401e-9982-7733d87daf99 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:03.026253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:03.071776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:03.072377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.072658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.072932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.074558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.180556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:03.182045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018f20-5762-4cc3-b2b3-9ab1f91ca0e4 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:03.200873 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 732/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:05.263802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.264332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.264332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.265597 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:05.270875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9468-6902-4db5-bed4-b9f89d1b650e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.271273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9468-6902-4db5-bed4-b9f89d1b650e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.271428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9468-6902-4db5-bed4-b9f89d1b650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.335360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8d1f9468-6902-4db5-bed4-b9f89d1b650e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:05.336556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d1f9468-6902-4db5-bed4-b9f89d1b650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.345077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:05.431452 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:05.469717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:05.471259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.569995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb273a5a-0d00-47fc-9fb7-00dbde08ca71 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.623237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:05.641818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.642430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.642707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.642986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.644549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.751701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.753140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6bdf-1f0b-4f68-a596-cdb0e9447e54 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.771123 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 728/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:07.810791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.811336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.811336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.813283 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:07.818429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb68-047e-41a6-a2c4-045edc87e9a8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.818854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb68-047e-41a6-a2c4-045edc87e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.818975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb68-047e-41a6-a2c4-045edc87e9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.884462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7f58cb68-047e-41a6-a2c4-045edc87e9a8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.885661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7f58cb68-047e-41a6-a2c4-045edc87e9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.924900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:07.981226 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:08.018436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.019960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:08.121748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e244866-b048-40a1-b65d-3866368e6791 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:08.158992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:08.194094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:08.194695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.194973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.195245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.197477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:08.302348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.303781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0dc1e-a0b4-409c-9ee3-213c903d4ba2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.321614 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 735/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:10.336611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.337148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.337148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.338455 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:10.343712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5b4c-6faf-4756-b391-e3761b40f7a7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.344134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5b4c-6faf-4756-b391-e3761b40f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.344343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5b4c-6faf-4756-b391-e3761b40f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.409280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-551f5b4c-6faf-4756-b391-e3761b40f7a7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:10.410510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-551f5b4c-6faf-4756-b391-e3761b40f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:10.427984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:10.505359 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:10.542221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:10.543759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:10.645183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde99b5-ffde-4c77-af3f-01100add2694 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:10.709453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:10.716047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:10.716645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.716923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.717201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.718941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:10.828006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:10.829882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009623a-6792-46ae-9410-ed86d613a020 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:10.848882 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 731/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:12.868366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.868935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.868935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.870315 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:12.876270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e5c9-b5ef-4263-b448-f6ceb924e725 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.876697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e5c9-b5ef-4263-b448-f6ceb924e725 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.876836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e5c9-b5ef-4263-b448-f6ceb924e725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.945230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-eaf1e5c9-b5ef-4263-b448-f6ceb924e725 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:12.946477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-eaf1e5c9-b5ef-4263-b448-f6ceb924e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:12.996713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:13.045710 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:13.082631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:13.084422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:13.188042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1220d4-9ece-418c-95ca-7f6e5e5cfb58 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:13.234587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:13.260336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:13.260936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:13.261218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:13.261493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:13.263117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:13.369441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:13.371045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69dc5-6ebf-4a90-bbd9-ca441d4c90ab service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:13.390084 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 738/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:23.043932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=22 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:23.387727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=66 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:32.947988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26689af-edec-49b1-8bea-b7ceaffb5239 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:32.948526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26689af-edec-49b1-8bea-b7ceaffb5239 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:32.948526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26689af-edec-49b1-8bea-b7ceaffb5239 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:32.950009 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 733/1471] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:32.955961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cc55-ee09-46a6-9cf2-79fca3409c12 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:32.956379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cc55-ee09-46a6-9cf2-79fca3409c12 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:32.956508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cc55-ee09-46a6-9cf2-79fca3409c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.023276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c2b1cc55-ee09-46a6-9cf2-79fca3409c12 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:33.024478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c2b1cc55-ee09-46a6-9cf2-79fca3409c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.118751 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 739/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:33.201956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.202590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.202882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.204289 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 734/1473] 10.222.0.36 () {54 vars in 966 bytes} [Sun Aug 7 01:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:33.209276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e6d-250f-430b-b2b0-c81be5562886 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.209567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e6d-250f-430b-b2b0-c81be5562886 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.209852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e6d-250f-430b-b2b0-c81be5562886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.284982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-29578e6d-250f-430b-b2b0-c81be5562886 None None] MFA Rules not processed for user `37ad903b3fcf4e1f90c6c8d2c716d3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:33.286219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-29578e6d-250f-430b-b2b0-c81be5562886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.306386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:33.360162 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 740/1474] 10.222.0.36 () {58 vars in 1063 bytes} [Sun Aug 7 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:33.367722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:33.369238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.474440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468a194-5cc2-486c-a89d-02f9ddc4fe9c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:33.545172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:33.546387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.546668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.546944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.548537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.601003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:33.656214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:33.657662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466fb0f-4e23-4d81-bad2-d3e1468e4abb service glance] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:33.676394 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 735/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:35.768834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:35.769424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:35.769424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:35.770765 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 741/1476] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:35.776033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe3f2-4958-4a59-8c0b-4fe68f6992f8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:35.776449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe3f2-4958-4a59-8c0b-4fe68f6992f8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:35.776589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe3f2-4958-4a59-8c0b-4fe68f6992f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:35.842569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c03fe3f2-4958-4a59-8c0b-4fe68f6992f8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:35.843782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c03fe3f2-4958-4a59-8c0b-4fe68f6992f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:35.939258 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 736/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:35.962373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:35.963908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:36.089549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf478-8433-4264-af0f-42fd70dbde16 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:36.137870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:36.181037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:36.181634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:36.181936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:36.182208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:36.182835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:36.184542 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:36.184542 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:11:36.184542 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:11:36.185678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944907e-402a-49db-9953-6e9750085628 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:36.207331 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 742/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Aug 7 01:11:35 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:38.234485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.234998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.234998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.236380 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 737/1479] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:38.241564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68433-65d3-40b2-98a8-f8bb3d10c3ec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.242047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68433-65d3-40b2-98a8-f8bb3d10c3ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.242149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d68433-65d3-40b2-98a8-f8bb3d10c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.306876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-94d68433-65d3-40b2-98a8-f8bb3d10c3ec None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:38.308087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-94d68433-65d3-40b2-98a8-f8bb3d10c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.402609 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 743/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:38.446155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.447689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.458318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.593280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cfdce-59e1-41e8-8c80-6913d41d6420 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.671172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.704234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.704828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.705101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.705368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.706979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.795198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.796927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f561e-eaf3-41bd-8636-ad1c1cbeaafc service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.815939 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 738/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:41.000474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.000955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.001050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.002435 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 744/1482] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:41.007530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd22e4-18a9-470f-b32f-3b8d75ce7b43 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.007980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd22e4-18a9-470f-b32f-3b8d75ce7b43 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.008076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd22e4-18a9-470f-b32f-3b8d75ce7b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.072691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f9fd22e4-18a9-470f-b32f-3b8d75ce7b43 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:41.073935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f9fd22e4-18a9-470f-b32f-3b8d75ce7b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:41.120800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.171548 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 739/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:41.207039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.208857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:41.231794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.311660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd7a5a-dbb8-4fa9-8944-7669602c012f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.383576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.384182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.384462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.384736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.386409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:41.459603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.493557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.494977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d190-dbe4-4843-a474-61b7d324a2f0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.512753 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 745/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:43.629281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051594-4ff2-4278-8774-9285a872869d None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:43.629893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051594-4ff2-4278-8774-9285a872869d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:43.629893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051594-4ff2-4278-8774-9285a872869d None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:43.631246 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 740/1485] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:43.636274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca33a-7b59-4088-848f-c2f6c3dbe918 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:43.636719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca33a-7b59-4088-848f-c2f6c3dbe918 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:43.636834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ca33a-7b59-4088-848f-c2f6c3dbe918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:43.701064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c35ca33a-7b59-4088-848f-c2f6c3dbe918 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:43.702917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c35ca33a-7b59-4088-848f-c2f6c3dbe918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:43.798676 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 746/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:43.837033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051594-4ff2-4278-8774-9285a872869d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:43.838628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5a051594-4ff2-4278-8774-9285a872869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:43.944787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051594-4ff2-4278-8774-9285a872869d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:44.019174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:44.020953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:44.021553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:44.021879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:44.022153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:44.023754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:44.135126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:44.136575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092a84-4196-494d-90ba-fcd8df0dcb71 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:44.154823 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 741/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:46.365157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:46.373290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:46.373290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:46.373290 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 747/1488] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:46.374140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201bc4-3118-4693-931a-87d44e73b8a5 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:46.374140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201bc4-3118-4693-931a-87d44e73b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:46.374140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201bc4-3118-4693-931a-87d44e73b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:46.441995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b1201bc4-3118-4693-931a-87d44e73b8a5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:46.443206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b1201bc4-3118-4693-931a-87d44e73b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:46.494302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:46.537514 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 742/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:46.579032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:46.580558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:46.616233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:46.684207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cc1d-2764-4ed4-8be5-6dca434ee0cc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:46.758065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:46.758681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:46.758970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:46.759243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:46.760876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:46.840389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:46.869274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:46.870813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f927b1d-ee3c-49d9-a50d-f342817cfe39 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:46.892599 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 748/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:49.291043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:49.291565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:49.291663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:49.292938 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 743/1491] 10.222.0.36 () {54 vars in 927 bytes} [Sun Aug 7 01:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:49.298535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d6d2-faa7-4020-9d93-91a6e86eaf40 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:49.298938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d6d2-faa7-4020-9d93-91a6e86eaf40 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:49.299092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819d6d2-faa7-4020-9d93-91a6e86eaf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:49.365524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9819d6d2-faa7-4020-9d93-91a6e86eaf40 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:49.370070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9819d6d2-faa7-4020-9d93-91a6e86eaf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:49.462754 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 749/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Sun Aug 7 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:49.502825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:49.504468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:49.606325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40115f-3748-4a05-8bdf-414d8899f5b5 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:49.677656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:49.678280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:49.678562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:49.678839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:49.680417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:49.690054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:49.788240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:49.789690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e68d62-c974-4aca-a7ff-a66fb9a1c159 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:49.807808 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 744/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:59.460974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:59.805660 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=50 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:08.329599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:08.330189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:08.330189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:08.404878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:08.406125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:08.500330 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 750/1494] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:08.508569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:08.509038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:08.509143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:08.583805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:08.584931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:08.679415 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 745/1495] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:08.684834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:08.686109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:08.697447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731b8dd-feef-445b-955a-e2b5ecf6cf80 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:08.757109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:08.790259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:08.790883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:08.791165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:08.791438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:08.792085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:13:08.792390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:08.793395 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:08.793395 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:13:08.793395 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:13:08.794315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:08.805691 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 751/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:13:08.814644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:08.824688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722248-7317-466f-a79d-9e18912cc83a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:08.884822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:08.918068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:08.918668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:08.918948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:08.919223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:08.919851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:08.921568 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:08.921568 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:13:08.921568 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:13:08.922805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.045551 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 746/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:08 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:09.049810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.051445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.085120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886a17-ccf9-4370-a5e3-8f85d8483c01 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.176347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.176863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.177141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.177409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.178059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.179074 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:09.179074 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:13:09.179074 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:13:09.180278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.278347 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 752/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:09.282702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.284202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.346319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef1f5-9c0e-442a-9c56-a0914a01404a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.429134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:09.439888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.440486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.440768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.441043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.441681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.442710 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:09.442710 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:13:09.442710 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:13:09.443611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.456097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 747/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:09.460288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.461857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.473957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5300c-1320-4924-b105-8fa2285063fb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.501850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:09.572537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.573187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.573554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.573858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.574501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.575513 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:09.575513 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:13:09.575513 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:13:09.576404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c64c8-f340-4cee-8693-986ba37d633c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.589415 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 753/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:09.593727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.595344 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.629942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667f48-4d4c-4e53-abeb-f6118d34fbb0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.722679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.723255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.723534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.723807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] PATH_INFO: `/v3/projects/1679db8b522a448589789cabadde014c/users/4704ae7784934422b8a6a87671fd35c8/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.744775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1679db8b522a448589789cabadde014c, user_id=4704ae7784934422b8a6a87671fd35c8, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.746081 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:09.746081 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:13:09.746081 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:13:09.748045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26675-0503-4be1-81c4-cc0fa6e5a1df admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.844897 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 748/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:09 2022] PUT /identity/v3/projects/1679db8b522a448589789cabadde014c/users/4704ae7784934422b8a6a87671fd35c8/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:09.857481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981537b-0230-4292-8105-de52f80fd7cc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.857798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981537b-0230-4292-8105-de52f80fd7cc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.858112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981537b-0230-4292-8105-de52f80fd7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.912901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d981537b-0230-4292-8105-de52f80fd7cc None None] MFA Rules not processed for user `4704ae7784934422b8a6a87671fd35c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:09.914137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d981537b-0230-4292-8105-de52f80fd7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.992651 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 754/1502] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:10.005807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.006130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.006412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.007764 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 749/1503] 10.222.0.36 () {54 vars in 964 bytes} [Sun Aug 7 01:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:13:10.013570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ce38d-c6ab-4e40-bfb1-c07550b3ddd8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.013884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ce38d-c6ab-4e40-bfb1-c07550b3ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.014189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ce38d-c6ab-4e40-bfb1-c07550b3ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.045216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.089248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b22ce38d-c6ab-4e40-bfb1-c07550b3ddd8 None None] MFA Rules not processed for user `5e19c7f04deb4b04b4c2d98ca7323b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:10.090984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b22ce38d-c6ab-4e40-bfb1-c07550b3ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.164325 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 755/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Sun Aug 7 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:10.172242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.173768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.224718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.279323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fda44-d5d2-4c5e-a769-d95bacb35820 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.352746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.353341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.353621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.353938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.356042 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.450913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.452335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.455745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.471548 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 750/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:10.517202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422797-c9a6-47c1-b0d9-04502fe6c146 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.517629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422797-c9a6-47c1-b0d9-04502fe6c146 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.517820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422797-c9a6-47c1-b0d9-04502fe6c146 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.519114 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 756/1506] 10.222.0.36 () {52 vars in 830 bytes} [Sun Aug 7 01:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:13:10.522719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.523925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.621260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb5f0-be4c-4471-be83-7323677c9d04 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.713585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.714297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.714576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.714854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] PATH_INFO: `/v3/users/4704ae7784934422b8a6a87671fd35c8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.727279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=4704ae7784934422b8a6a87671fd35c8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.728305 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:10.728305 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:13:10.728305 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:13:10.730093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.739587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.954832 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4704ae7784934422b8a6a87671fd35c8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.969532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4704ae7784934422b8a6a87671fd35c8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:11.037443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4704ae7784934422b8a6a87671fd35c8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:11.037907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4704ae7784934422b8a6a87671fd35c8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:11.061642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4704ae7784934422b8a6a87671fd35c8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:11.067366 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 751/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:10 2022] DELETE /identity/v3/users/4704ae7784934422b8a6a87671fd35c8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:11.071934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.072226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.072534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.132537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:11.133751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.209546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:11.222264 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 757/1508] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:11.232017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.233239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.332096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4be748-b541-45a8-ae24-36d4e9037ede admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.388208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:11.406741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.407347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.407629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.407907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.409526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.518076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.519941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23598-b311-48c0-b54c-0e6b751fb473 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.538081 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 752/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:12.056854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:12.058203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:12.070866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26218eaa-5584-47b7-af03-92dfcea71597 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:12.166346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:12.166970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:12.167245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:12.167513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] PATH_INFO: `/v3/projects/1679db8b522a448589789cabadde014c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:12.177474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1679db8b522a448589789cabadde014c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:12.178526 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:13:12.178526 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:13:12.178526 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:13:12.179714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:12.304571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1679db8b522a448589789cabadde014c', 'request_id': 'req-7bc56612-1b78-4ff3-991c-a3516de44079'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:12.311424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1679db8b522a448589789cabadde014c', 'request_id': 'req-7bc56612-1b78-4ff3-991c-a3516de44079'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:12.324502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1679db8b522a448589789cabadde014c', 'request_id': 'req-7bc56612-1b78-4ff3-991c-a3516de44079'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:12.403935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] The token cache is being invalidate because project 1679db8b522a448589789cabadde014c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:12.404228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:12.404661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7bc56612-1b78-4ff3-991c-a3516de44079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:12.407179 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 758/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:12 2022] DELETE /identity/v3/projects/1679db8b522a448589789cabadde014c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:21.558996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=62 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:22.401451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:48.989306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:48.989849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:48.989979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:48.991254 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:14:48.996140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ca47-26a7-4a9c-90b7-1e5bf8a1b734 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:48.996607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ca47-26a7-4a9c-90b7-1e5bf8a1b734 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:48.996712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ca47-26a7-4a9c-90b7-1e5bf8a1b734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:49.074762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3478ca47-26a7-4a9c-90b7-1e5bf8a1b734 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:49.075959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3478ca47-26a7-4a9c-90b7-1e5bf8a1b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:49.179223 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:49.333148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:49.335332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:49.452098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565d9c6-31fa-448e-881f-f78ad091ca23 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:49.457747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:49.458377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:49.458663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:49.458941 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:49.467552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:49.469140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c2cd-34e2-4bac-abde-bfb58eff823d service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:49.478374 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 754/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:50.312600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac66-c2be-4b73-9b04-0f22ac02b398 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:50.313148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac66-c2be-4b73-9b04-0f22ac02b398 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:50.313148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac66-c2be-4b73-9b04-0f22ac02b398 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:50.314447 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:14:50.319227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c10a1-7fcf-41d5-afa1-2f9dfc7c3916 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:50.319664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c10a1-7fcf-41d5-afa1-2f9dfc7c3916 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:50.319767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c10a1-7fcf-41d5-afa1-2f9dfc7c3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:50.339274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-827c10a1-7fcf-41d5-afa1-2f9dfc7c3916 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:50.340474 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-827c10a1-7fcf-41d5-afa1-2f9dfc7c3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:50.348156 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:50.501351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aac66-c2be-4b73-9b04-0f22ac02b398 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:50.516278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aac66-c2be-4b73-9b04-0f22ac02b398 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:50.521684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:50.522310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:50.522593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:50.522868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:50.531102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:50.532694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310e372-a441-4fd3-916c-62ec31f3d65d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:50.542242 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 761/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:51.034329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867555e-7d60-4c25-8554-00a8a74ea34e None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:51.034657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867555e-7d60-4c25-8554-00a8a74ea34e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:51.034884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867555e-7d60-4c25-8554-00a8a74ea34e None None] PATH_INFO: `/v3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:51.036232 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 756/1517] 10.222.0.45 () {54 vars in 925 bytes} [Sun Aug 7 01:14:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:14:51.043298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2109-5781-454e-a79e-fd71a2720823 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:51.043586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2109-5781-454e-a79e-fd71a2720823 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:51.043861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2109-5781-454e-a79e-fd71a2720823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:51.102744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-894b2109-5781-454e-a79e-fd71a2720823 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:51.104019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-894b2109-5781-454e-a79e-fd71a2720823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:51.120932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:51.180192 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 762/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 7 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:00.334438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=56 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:01.164479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473a4d-7734-4edd-ba7f-1af57ea21194 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.164787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473a4d-7734-4edd-ba7f-1af57ea21194 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.165098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45473a4d-7734-4edd-ba7f-1af57ea21194 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.166736 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 757/1519] 10.222.0.36 () {54 vars in 961 bytes} [Sun Aug 7 01:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:01.171860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0510-2e11-4ea5-a858-dab0abbc65bf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.172355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0510-2e11-4ea5-a858-dab0abbc65bf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.172455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0510-2e11-4ea5-a858-dab0abbc65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.178419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=23 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:01.192170 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab0e0510-2e11-4ea5-a858-dab0abbc65bf None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:01.193493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab0e0510-2e11-4ea5-a858-dab0abbc65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:01.203144 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 763/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Aug 7 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:01.210790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45473a4d-7734-4edd-ba7f-1af57ea21194 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:01.224472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45473a4d-7734-4edd-ba7f-1af57ea21194 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:01.229886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:01.230481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.230769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.231050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.239236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:01.240828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23beee3-8ffe-458e-b942-5a4e8dbd56f6 service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:01.251301 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 758/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:01.774545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a925e10-d8f1-4ae4-a822-a2a390737e7e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.774854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a925e10-d8f1-4ae4-a822-a2a390737e7e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.775128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a925e10-d8f1-4ae4-a822-a2a390737e7e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.776551 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:01.781395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceeea9-eda0-478a-976a-ef42f4753d67 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.781874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceeea9-eda0-478a-976a-ef42f4753d67 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.781992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceeea9-eda0-478a-976a-ef42f4753d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.800858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8bceeea9-eda0-478a-976a-ef42f4753d67 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:01.802113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8bceeea9-eda0-478a-976a-ef42f4753d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:01.810602 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:01.966904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a925e10-d8f1-4ae4-a822-a2a390737e7e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:01.982362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a925e10-d8f1-4ae4-a822-a2a390737e7e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:01.988089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:01.988682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.988961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.989234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.997783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:01.999400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e282c2c-d937-453c-af03-52daf2e64b35 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:02.008707 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 765/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:02.841442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ed6a8-78ca-4267-91f5-f37f165b8a04 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:02.841991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ed6a8-78ca-4267-91f5-f37f165b8a04 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:02.841991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ed6a8-78ca-4267-91f5-f37f165b8a04 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:02.843311 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:02.848269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccec4-3d74-4bda-8daf-d0f9fb4c42b1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:02.848717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccec4-3d74-4bda-8daf-d0f9fb4c42b1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:02.848839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccec4-3d74-4bda-8daf-d0f9fb4c42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:02.868469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bb1ccec4-3d74-4bda-8daf-d0f9fb4c42b1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:02.870356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bb1ccec4-3d74-4bda-8daf-d0f9fb4c42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:02.878226 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:03.031017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ed6a8-78ca-4267-91f5-f37f165b8a04 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:03.045701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ed6a8-78ca-4267-91f5-f37f165b8a04 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:03.050999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:03.051584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:03.051866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:03.052140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:03.060650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:03.062276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439212e-65a3-4431-81a0-48a55bf75d40 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:03.071409 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 761/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:07.027271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.027788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.027886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:07.029205 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:15:07.034272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdaa20-1f66-47fa-bad2-8b3f7e064bb3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.034706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdaa20-1f66-47fa-bad2-8b3f7e064bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.034841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdaa20-1f66-47fa-bad2-8b3f7e064bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:07.054020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-50cdaa20-1f66-47fa-bad2-8b3f7e064bb3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:07.055218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-50cdaa20-1f66-47fa-bad2-8b3f7e064bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:07.063545 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:07.136647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:07.138428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:07.216066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ce30-24b4-4c1d-96d8-a826e8d49014 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:07.219680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:07.220284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.220571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.220857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:07.229897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:07.231306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224ff54-bf49-4ddf-bea7-2744bf8c2afa service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:07.240653 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 768/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:09.242783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c0d0-113a-4aba-8edb-78351b227688 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.243323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c0d0-113a-4aba-8edb-78351b227688 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.243432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c0d0-113a-4aba-8edb-78351b227688 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.244899 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:09.250183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331d3-22d1-4ed2-a768-134a7dc3108b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.250578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331d3-22d1-4ed2-a768-134a7dc3108b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.250754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331d3-22d1-4ed2-a768-134a7dc3108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.269647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-388331d3-22d1-4ed2-a768-134a7dc3108b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:09.270931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-388331d3-22d1-4ed2-a768-134a7dc3108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.279257 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:09.315605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c0d0-113a-4aba-8edb-78351b227688 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:09.326102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c0d0-113a-4aba-8edb-78351b227688 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.329761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.330378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.330656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.330929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.339988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.341411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafdad2-bfbd-4a2b-a384-e04502f03cd4 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.350755 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 764/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:13.046392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.046944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.046944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.048297 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:13.053484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642fa9-4206-4622-b749-cedd3e1835b3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.053914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642fa9-4206-4622-b749-cedd3e1835b3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.054084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642fa9-4206-4622-b749-cedd3e1835b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.072967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ab642fa9-4206-4622-b749-cedd3e1835b3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:13.074192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ab642fa9-4206-4622-b749-cedd3e1835b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:13.082277 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:13.386417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.395049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:13.465740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c1b97-a2c9-47f9-a2a7-d17b7b73436f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:13.469306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:13.469937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.470220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.470496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.479242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:13.480666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ef557-bb44-4d0c-a772-2dbb468957d9 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.489876 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 771/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:15.513679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.514291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.514291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.515613 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:15.520670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6cd7-8526-49d6-8d55-b008ebface9a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.521080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6cd7-8526-49d6-8d55-b008ebface9a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.521294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6cd7-8526-49d6-8d55-b008ebface9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.541653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-59ac6cd7-8526-49d6-8d55-b008ebface9a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:15.542881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-59ac6cd7-8526-49d6-8d55-b008ebface9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:15.550581 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:15.853729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:15.855647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:15.868426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38489cef-381b-48ad-a7d7-1b398c873d50 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:15.872124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:15.872709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.872991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.873268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.882030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:15.883448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912cb3-7e19-42ab-a7c9-fdc496377b4d service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:15.893384 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 767/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:25.536186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:25.889261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=33 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:49.767480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.768803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.768803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.795083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:49.801957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:49.810406 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 773/1540] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:49.819877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f381d-52c9-4a4c-961b-a7fe549c6454 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.821002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f381d-52c9-4a4c-961b-a7fe549c6454 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.821499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f381d-52c9-4a4c-961b-a7fe549c6454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.857974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-171f381d-52c9-4a4c-961b-a7fe549c6454 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:49.859594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-171f381d-52c9-4a4c-961b-a7fe549c6454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:49.874427 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 768/1541] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:49.879687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:49.888755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4336-874e-4d10-974e-51e279d20f41 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.889335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4336-874e-4d10-974e-51e279d20f41 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.889807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4336-874e-4d10-974e-51e279d20f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.890724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456e2c1-a316-4144-bf55-bfc93bdf09b5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:49.902818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:49.903453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.903732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.904005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.904671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:49.909897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:49.909897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:49.924676 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 774/1542] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:49.933552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:49.935309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a73b4336-874e-4d10-974e-51e279d20f41 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:49.937092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a73b4336-874e-4d10-974e-51e279d20f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:49.952184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3597e-5300-425f-bf5c-468d733091b6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:49.954954 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 769/1543] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:49.957401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:49.958045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.958323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.958594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.959227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:49.960386 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:49.960386 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:16:49.960386 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:16:49.961784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ef7c8-8413-419a-a9b0-5dfaff440eb1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:49.966577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:49.967277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:49.967777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:49.995723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:49.997504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.020331 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 770/1544] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:50.026974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.042863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b08c6-e3a9-42dc-9635-7a80327346ae None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.055493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.056504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.057011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.057505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.058431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.058976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.060589 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:50.060589 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:16:50.060589 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:16:50.061867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.081095 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 771/1545] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.091820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.107441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e543a8-7bb0-487e-b202-f31844787889 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.124276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.124276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.124276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.124276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.124740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.124740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.172108 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 775/1546] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:16:50.174004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c48be-58da-44ae-8583-0b08ac69d163 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.174534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c48be-58da-44ae-8583-0b08ac69d163 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.175178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c48be-58da-44ae-8583-0b08ac69d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.210351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-906c48be-58da-44ae-8583-0b08ac69d163 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.210766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-906c48be-58da-44ae-8583-0b08ac69d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.267696 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 772/1547] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:50.268550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.290829 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 776/1548] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.292071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae81-a0f3-453b-b220-f46656a46f34 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.292364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae81-a0f3-453b-b220-f46656a46f34 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.292647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae81-a0f3-453b-b220-f46656a46f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.314680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-da73ae81-a0f3-453b-b220-f46656a46f34 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.316016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-da73ae81-a0f3-453b-b220-f46656a46f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.346566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeabc32-4f11-4848-99c0-0ff709524879 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.352428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.353819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.354137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.354416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.355040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.356083 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:50.356083 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:16:50.356083 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:16:50.357811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075f5b6-37c0-42a4-bbed-ec10622f1e6f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.377925 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 777/1549] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.379310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285e38-cc1c-461e-9655-6a280253cfef None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.379605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285e38-cc1c-461e-9655-6a280253cfef None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.379909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59285e38-cc1c-461e-9655-6a280253cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.398889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-59285e38-cc1c-461e-9655-6a280253cfef None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.400079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-59285e38-cc1c-461e-9655-6a280253cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.407947 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 778/1550] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.409160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.409447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.409751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.429184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.430462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.439185 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 779/1551] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.439953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.444567 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 773/1552] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:50.455417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006bf-8deb-4008-a60e-c90314d97e19 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.455417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006bf-8deb-4008-a60e-c90314d97e19 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.455417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006bf-8deb-4008-a60e-c90314d97e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.455747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee2c0-7b65-439b-87fd-14de3552d0d6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.455747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.455953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.456473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.456473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.457034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.459104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc1454-c0a1-4418-a987-2ac0a995439d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.468987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-fa7006bf-8deb-4008-a60e-c90314d97e19 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.470293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fa7006bf-8deb-4008-a60e-c90314d97e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.479027 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 774/1553] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.480292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5773d-7b87-4447-af27-91afd1e5031f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.480579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5773d-7b87-4447-af27-91afd1e5031f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.480856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5773d-7b87-4447-af27-91afd1e5031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.499671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-59e5773d-7b87-4447-af27-91afd1e5031f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.500890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-59e5773d-7b87-4447-af27-91afd1e5031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.508790 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 775/1554] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.509946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d9e8-5ba1-4a2a-93cb-ddf676a6e873 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.510231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d9e8-5ba1-4a2a-93cb-ddf676a6e873 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.510507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d9e8-5ba1-4a2a-93cb-ddf676a6e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.529343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cbe4d9e8-5ba1-4a2a-93cb-ddf676a6e873 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.530530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cbe4d9e8-5ba1-4a2a-93cb-ddf676a6e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.538862 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 776/1555] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.540029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bbfdb-d75d-4d2b-bcc6-44cfe315d18d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.540313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bbfdb-d75d-4d2b-bcc6-44cfe315d18d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.540628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bbfdb-d75d-4d2b-bcc6-44cfe315d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.559382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3a6bbfdb-d75d-4d2b-bcc6-44cfe315d18d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.560489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3a6bbfdb-d75d-4d2b-bcc6-44cfe315d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.561052 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 780/1556] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:50.562384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.562669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.562969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.570722 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 777/1557] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.573218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee7be-9f76-46e4-a552-cbc872f3cf66 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.573511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee7be-9f76-46e4-a552-cbc872f3cf66 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.573789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee7be-9f76-46e4-a552-cbc872f3cf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.583050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.585642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.593007 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 781/1558] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.593895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.595037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-78dee7be-9f76-46e4-a552-cbc872f3cf66 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.596226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-78dee7be-9f76-46e4-a552-cbc872f3cf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.605128 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 778/1559] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.606843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfc962-c255-48cc-9170-706f6c9be7ec None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.607127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e84f-98e7-48b8-b87b-bef670fff51d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.607479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e84f-98e7-48b8-b87b-bef670fff51d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.607702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e84f-98e7-48b8-b87b-bef670fff51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.611644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.614420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.614420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.614420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.614420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.615059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.625296 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 782/1560] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:50.626143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.627006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c7f2e84f-98e7-48b8-b87b-bef670fff51d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.628606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c7f2e84f-98e7-48b8-b87b-bef670fff51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.630953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:50.637004 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 779/1561] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.637150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb47f-8a7c-44c8-b528-4e1c7f06ed53 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.638217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.638515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.638797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.644580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.647974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.647974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.647974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.647974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.647974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.649018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.658537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:50.659733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:50.660865 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 783/1562] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.661702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.670246 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 780/1563] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:50.671177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.675828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d51d5-78c5-4519-b43e-2a9a3460b177 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.681916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.682067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff375b1-799a-458c-a18c-c9970788deb8 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.682192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.682192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.682192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.682457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.683865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.685370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.686013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.686299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.686584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.687218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.687526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.689117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.693628 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 784/1564] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:50.696921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.701282 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 781/1565] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.702118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.712782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480e6dc-230f-4a9c-910f-b91ec5456b5a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.716254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e74-9cb7-4070-bf91-bc64c768e6d6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.717424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.717950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.718093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.718313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.718569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.718684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.718854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.719127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.719232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.719528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.719763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.720070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.721122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.721696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.733562 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 782/1566] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.734645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.741444 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 785/1567] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.742316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.745249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6ddc-a1a3-4a37-ac12-5f275ffb3816 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.750634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.750634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.750906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.751206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.751845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.752304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811bf03-f4a1-4bd2-9ecd-51da83466666 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.753445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.757768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.758404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.758692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.758994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.759635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.759942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.761529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.764444 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 783/1568] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:50.765271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.774656 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 786/1569] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.775526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f713-2210-49ef-a1e2-4b95f833c89b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.775658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.780420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.781007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.781287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.781561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.782229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.784149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.786319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2215-8365-4656-93b5-8088dd937ac2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.791125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.791713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.791998 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.792276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.792984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:50.793313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.794898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.798231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:50.807063 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 787/1570] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:50.807935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.821232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2b0c1-54f2-48c3-be63-80713d7da1fa admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.822937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.823514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.823796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.824071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.824701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.826310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.836983 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 788/1571] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:50.837879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.847666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1c30-6325-47b0-86db-0a999648875f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.852783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.853346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.853629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.853940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.854544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.856449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.899357 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 784/1572] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:50.900300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:50.964299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed68f-486a-41d9-9cee-9fddc70fc38d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:50.968885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:50.969485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:50.969769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:50.970075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:50.970701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:50.972640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:50.991547 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 789/1573] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:50.993668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.057588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16796b-6ff9-4059-91a1-b38ef8a44a44 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.062329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.062928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.063226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.063488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.064117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.066134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.237991 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 790/1574] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.237991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.251079 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 785/1575] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:50 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.251079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.287139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:51.299070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af677-433c-4177-af22-6296d713fe18 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.310677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8172d-2205-4f17-9d64-a560fe46c01a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.315369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.315994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.316278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.316553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.317184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.319280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.354705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.355360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.355640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.355916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] PATH_INFO: `/v3/projects/6e84809683e046abb1963435906f5fe9/users/51f00971f84945329095ca8b846dfb90/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.369960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e84809683e046abb1963435906f5fe9, user_id=51f00971f84945329095ca8b846dfb90, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.370986 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:51.370986 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:16:51.370986 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:16:51.372953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.476129 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 786/1576] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.476940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.511175 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 791/1577] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:51 2022] PUT /identity/v3/projects/6e84809683e046abb1963435906f5fe9/users/51f00971f84945329095ca8b846dfb90/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:51.511175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.545812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9ebc-5da1-4029-9734-7ad3fd83082f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.549330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:51.560359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ad3b1-e761-44d0-99a8-9844f3ed7265 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.565421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.566110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.566389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.566662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] PATH_INFO: `/v3/projects/fc3a83aac14941e0b7ac06feccc04b5e/users/05dae98109b14ac7a5b4bcaaeb17e00c/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.581990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3a83aac14941e0b7ac06feccc04b5e, user_id=05dae98109b14ac7a5b4bcaaeb17e00c, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.585230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.602323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.602928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.603209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.603484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.604103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.606084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.651941 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 792/1578] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:51 2022] PUT /identity/v3/projects/fc3a83aac14941e0b7ac06feccc04b5e/users/05dae98109b14ac7a5b4bcaaeb17e00c/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:51.653497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.714194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16f96-0823-4758-a4f1-c0e9676b1d5a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.718773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.719366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.719646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.719918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.720526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.722462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.732104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:51.738878 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 787/1579] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.739874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.800696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1ba04-c702-4880-849b-a832f735da93 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.805755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.809904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.809904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.809904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.809904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.809904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.857571 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 793/1580] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.858410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.868591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e79c3-5896-472b-ac63-d451cf17ba77 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.873256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.873935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.874213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.874506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.875109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.877035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.946451 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 788/1581] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.946451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.954756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172608-e295-4c49-a9e6-d9d0b79c1f16 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:51.959428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:51.960041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:51.960369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:51.960640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:51.961242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:51.963179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595f40-70a6-430f-82af-b2299a526604 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:51.984577 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 794/1582] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:51.985381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:51.995738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9465b1-f0f7-4f53-8a3a-04e107066035 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.000519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.001348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.001787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.002250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.003013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.005107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090598e-df3f-45d0-bfa3-c707bf1dec95 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.051874 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 789/1583] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:52.053048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.053865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.054143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.081902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] MFA Rules not processed for user `51f00971f84945329095ca8b846dfb90`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:52.083102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:52.113910 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 795/1584] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:51 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:52.115145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.115424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.115718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.143607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.144173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] MFA Rules not processed for user `05dae98109b14ac7a5b4bcaaeb17e00c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:52.145394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:52.153824 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 790/1585] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:52.159909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.164833 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c8a19-a90f-40d5-92fa-ec7f728508d9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.169700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.170362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.170642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.170917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.171551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.173515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.228843 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 796/1586] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:52.229687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.239888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2931e-bab0-421b-87b3-1441ebeab913 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.246260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.246870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.247154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.247429 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.248107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.249710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.260398 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 797/1587] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.261088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.270569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96257b9-03aa-4a80-a3d0-cc7ec8bcf0c1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.275511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.276074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.276363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.276639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.277394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.279004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.285932 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 791/1588] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:52 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:52.285932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.298347 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 798/1589] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.298347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.298573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013ae6-c108-4411-8c56-64c7d4425a09 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.299622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9510588-afdd-410f-83cc-0c9417726014 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.300956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.301662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.302017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.302242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.302881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.305306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.305460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.306073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.306359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.306830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.307841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.309526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86483088-2f9f-49fd-88dc-5ae0a253a830 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.315624 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 792/1590] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.316424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.321598 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 799/1591] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.323422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b946d-95af-477b-8c6e-5dc8e1653d97 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.323965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b946d-95af-477b-8c6e-5dc8e1653d97 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.324376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b946d-95af-477b-8c6e-5dc8e1653d97 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.325740 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 800/1592] 10.222.0.36 () {54 vars in 962 bytes} [Sun Aug 7 01:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:16:52.326171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2f4d-c08b-4646-89fc-677721524b80 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.326823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb205-8ce0-49f7-b682-e778421170dc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.327108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb205-8ce0-49f7-b682-e778421170dc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.327745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb205-8ce0-49f7-b682-e778421170dc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.329213 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 801/1593] 10.222.0.36 () {54 vars in 962 bytes} [Sun Aug 7 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:16:52.330015 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb205-8ce0-49f7-b682-e778421170dc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.331499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.332089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.332374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.332650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.333282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.335178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.344060 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb205-8ce0-49f7-b682-e778421170dc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.346270 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 793/1594] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.347158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.348680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.349271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.349549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.349821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.353515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.353515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.357272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432d05d-d9f9-4973-8275-bbfd55f27d15 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.361933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.362517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.366854 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 802/1595] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.366992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.366992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.367167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.367259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.367259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.373361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f0b1-af48-4863-adc5-f03a548fe078 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.376878 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 794/1596] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.377439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.381724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.382486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.382762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.383032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.383673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.385274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.387410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb710-d9fa-460e-93a6-38cca26aa3d3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.392026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.398892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.398892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.398892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.398892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.398892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684e306-5f04-4874-b4fb-437c6ca8de35 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.399373 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 803/1597] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.399373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.406042 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 795/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.406204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d5577-fabe-4da9-a18f-6f1203e42418 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.407482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.407877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.408266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.410827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.411417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.411696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.411973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.413137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.414865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dcba2-3610-4d3a-9ece-13a569d7cfbf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.426577 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 804/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.427902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.428192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.429134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.448678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:52.449951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:52.457500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:52.458705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:52.489627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.522491 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 796/1600] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Aug 7 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:52.523498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.526293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 805/1601] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Aug 7 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:52.527288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.537499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ed2a-5347-4283-89a1-425607ca2018 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.538302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b8671-bf51-4e08-a6c0-41116b62bc06 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.542821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.543461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.543741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.543914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.544131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] PATH_INFO: `/v3/projects/6785d30930ee41d88a31ff0760f8d699/users/598402f6609c422cbcc0dd0bfae53430/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.544520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.544813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.545120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.545746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.547406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.558499 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 797/1602] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.559229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.559719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6785d30930ee41d88a31ff0760f8d699, user_id=598402f6609c422cbcc0dd0bfae53430, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.562515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.571010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003102-540f-4b04-a48a-24d310d51ce9 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.578607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.578607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.578607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.578607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] PATH_INFO: `/v3/projects/0abd0ab6a2794a0a80f8581e9fbde1da/users/825a37a0e63c423da11273406e8b02f1/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.593618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abd0ab6a2794a0a80f8581e9fbde1da, user_id=825a37a0e63c423da11273406e8b02f1, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.596311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.634848 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 806/1603] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:52 2022] PUT /identity/v3/projects/6785d30930ee41d88a31ff0760f8d699/users/598402f6609c422cbcc0dd0bfae53430/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:52.636423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.653166 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 798/1604] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:52 2022] PUT /identity/v3/projects/0abd0ab6a2794a0a80f8581e9fbde1da/users/825a37a0e63c423da11273406e8b02f1/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:52.654270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.693062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.697422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bffb2-4325-4cbf-a01f-1522c14d384c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.716734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343fad5-3b63-403e-a536-cd00f69e35a2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.721511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.722192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.722496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.722777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] PATH_INFO: `/v3/projects/3e62884877034740b93cef500446d246/users/80dad7e132d848559aa3529427e92f6e/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.737817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e62884877034740b93cef500446d246, user_id=80dad7e132d848559aa3529427e92f6e, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.740628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.754642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.755246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.755524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.755791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.756427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.758070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.768634 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 807/1605] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:52.769395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.779564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d4267-4931-412a-991a-2293ff97a0e0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.784283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.784910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.785192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.785467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] PATH_INFO: `/v3/projects/440652d4d24d4a34985625be49c12a70/users/4c8389683e844b989fe5cbe779327933/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.800344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=440652d4d24d4a34985625be49c12a70, user_id=4c8389683e844b989fe5cbe779327933, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:52.803106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:52.806347 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 799/1606] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:52 2022] PUT /identity/v3/projects/3e62884877034740b93cef500446d246/users/80dad7e132d848559aa3529427e92f6e/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:52.807923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.876939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ca4e-7711-4692-a129-b4d854c78ce1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.880418 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 808/1607] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:52 2022] PUT /identity/v3/projects/440652d4d24d4a34985625be49c12a70/users/4c8389683e844b989fe5cbe779327933/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:52.881384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:52.908757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:52.943591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.944757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.945046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.945331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:52.958516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38239c45-7e19-414e-afc8-ac739fa33aff admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:52.964678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:52.965316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:52.965601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:52.965901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.003217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:53.007711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.008633 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.017820 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 800/1608] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.018713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.028246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.029984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5153d93-cf68-429c-aab4-edc061dd7c2d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.041610 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 809/1609] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.043142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba4ae-b3bb-40bb-99bc-740054fba164 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.043431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba4ae-b3bb-40bb-99bc-740054fba164 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.043760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba4ae-b3bb-40bb-99bc-740054fba164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.071752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d1eba4ae-b3bb-40bb-99bc-740054fba164 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.073610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d1eba4ae-b3bb-40bb-99bc-740054fba164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.083754 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 810/1610] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.084827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc153eca-1ce6-40f4-97d1-8fa780d73019 service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.085213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.085500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.085852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.090951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.091850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.092230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.092686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] PATH_INFO: `/v3/projects/90a4367254cc4a318f7abe3a16821bf8/users/f270593db29b4835952de74f591011c5/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.110129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.111347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.112331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a4367254cc4a318f7abe3a16821bf8, user_id=f270593db29b4835952de74f591011c5, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.119416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624d2ce-1940-47cb-8a4f-2a12354b74a9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.123878 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 811/1611] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.123878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.138091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a1dc6-77da-4be6-be0a-c3abe6bb00e7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.140876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.141635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.142144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.142515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] PATH_INFO: `/v3/projects/d9d7dbe4684843fcaa03f9f1d571c9f9/users/a7057a0481a54dbabd5451f2ff7c498e/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.159393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d7dbe4684843fcaa03f9f1d571c9f9, user_id=a7057a0481a54dbabd5451f2ff7c498e, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.162394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea918fc-9821-4a25-8a53-750212525b91 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.203834 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 801/1612] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:53 2022] PUT /identity/v3/projects/90a4367254cc4a318f7abe3a16821bf8/users/f270593db29b4835952de74f591011c5/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:53.203834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.203834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.203834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.237634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] MFA Rules not processed for user `80dad7e132d848559aa3529427e92f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.237634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.276793 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 812/1613] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:53 2022] PUT /identity/v3/projects/d9d7dbe4684843fcaa03f9f1d571c9f9/users/a7057a0481a54dbabd5451f2ff7c498e/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:53.293206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.293206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.293206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.306652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.308751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.338678 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 802/1614] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.339693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.344117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.379030 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 813/1615] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.380059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.406354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:53.407843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0be36-8ded-45db-a958-45afa2039002 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.426196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:53.436446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc229aa2-9ade-46a0-b329-4aa6d8151b63 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.440388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.440897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.441186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.441464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.450548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.451982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b86316-9a26-434d-8e4d-528258ebefd8 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.457645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.458493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.458960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.459284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.462953 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 814/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.464293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23937854-7b92-455c-96ac-c0820129912f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.464592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23937854-7b92-455c-96ac-c0820129912f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.464882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23937854-7b92-455c-96ac-c0820129912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.469797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.473509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0c662-4efa-41ff-8f84-c8553af7a5fb service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.485611 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 803/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.486914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-23937854-7b92-455c-96ac-c0820129912f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.487043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d385fd1-dfb5-43e8-bc10-68867a7c081b None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.487322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d385fd1-dfb5-43e8-bc10-68867a7c081b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.487594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d385fd1-dfb5-43e8-bc10-68867a7c081b None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.488235 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-23937854-7b92-455c-96ac-c0820129912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.489410 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 804/1618] 10.222.0.36 () {54 vars in 912 bytes} [Sun Aug 7 01:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:16:53.490535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c786-4343-41ca-9093-3bc13943fa71 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.490958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c786-4343-41ca-9093-3bc13943fa71 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.491287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c786-4343-41ca-9093-3bc13943fa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.497275 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 815/1619] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.497275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af607-bb5b-4507-851a-2da94081bc9d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.497275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af607-bb5b-4507-851a-2da94081bc9d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.497275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af607-bb5b-4507-851a-2da94081bc9d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.505361 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 816/1620] 10.222.0.36 () {54 vars in 912 bytes} [Sun Aug 7 01:16:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:16:53.506363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08af607-bb5b-4507-851a-2da94081bc9d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.517610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08af607-bb5b-4507-851a-2da94081bc9d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.521476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.523898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.523898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.523898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.525726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7c23c786-4343-41ca-9093-3bc13943fa71 None None] MFA Rules not processed for user `a7057a0481a54dbabd5451f2ff7c498e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.527009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7c23c786-4343-41ca-9093-3bc13943fa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.532677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.534155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b90e-f064-4cf7-83cc-5f6b8e14a2a1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.545569 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 817/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.547102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.547908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.548581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.569048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.573032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.602920 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 805/1622] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.602920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.602920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.602920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.634163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:53.636033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:53.658995 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 818/1623] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.658995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.688263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2ea3b-080f-4636-a2ea-df110dc78a08 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.692634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.693258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.693545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.694704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.716553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.717761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.724205 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 806/1624] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:53.724961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.729768 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 819/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.730833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:53.787352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:53.794160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac6cc-8d20-4fd8-8ce7-6565a8e0afcb None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.799048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6c2c-c42b-40bd-8bf7-3a7afdcca641 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:53.803316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.803316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.803316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.803316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.803814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:53.804099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:53.804415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:53.804694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:53.815136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.817319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.832268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:53.836620 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 807/1626] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:53.837254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:53.864977 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 820/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:54.908276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:54.919538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888554a-c116-435c-a28e-80bd41cfcf37 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:54.923546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:54.924260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:54.924615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:54.924961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:54.939731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:54.942686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444a04-f4b7-4051-a5ce-a80db9fc2d8f service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:54.960781 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 808/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:55.317522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:55.352737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae6f5-3af8-4252-8da1-3137f818c4fd service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:55.370755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:55.371374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:55.371654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:55.371928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:55.403800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:55.458546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:55.460239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:55.469537 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 821/1629] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:55.766890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:55.767215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:55.767459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:55.813293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] MFA Rules not processed for user `825a37a0e63c423da11273406e8b02f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:55.815129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:55.844501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:55.859793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fffb57-aa4d-45d0-aae2-56e5c7661c82 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:55.873256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:55.873256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:55.873256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:55.873256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] PATH_INFO: `/v3/users/80dad7e132d848559aa3529427e92f6e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:55.873656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dad7e132d848559aa3529427e92f6e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:55.873656 dv-cinder-master-3-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:55.873656 dv-cinder-master-3-smb devstack@keystone.service[80508]: warnings.warn(msg) Aug 07 01:16:55.873656 dv-cinder-master-3-smb devstack@keystone.service[80508]: Aug 07 01:16:55.874904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.339205 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 809/1630] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:56.339205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.339205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b5c5-37ce-452a-b582-ac0bfeb09b3e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.339205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.344528 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 810/1631] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:56 2022] POST /identity/v3/projects => generated 405 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:56.350577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.421092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cea060-348f-4a4e-8953-a21166b9c7d5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.421269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dad7e132d848559aa3529427e92f6e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:56.427231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.428800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.429393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.429909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.430759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:56.432950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.536450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dad7e132d848559aa3529427e92f6e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:56.546624 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 811/1632] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:56 2022] POST /identity/v3/users => generated 309 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:56.548250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.570285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f0a33-e3fc-4540-9a29-6ad5d7f53fdf admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.575243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dad7e132d848559aa3529427e92f6e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:56.576991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dad7e132d848559aa3529427e92f6e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:56.581550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.582497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.582923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.583335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.584171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:56.586408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.602892 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 812/1633] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:16:56.607072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.609648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:56.611576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8e359a35-d053-4949-bb92-04b4ac51ecf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dad7e132d848559aa3529427e92f6e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:56.620241 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 822/1634] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:55 2022] DELETE /identity/v3/users/80dad7e132d848559aa3529427e92f6e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:16:56.624783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.625267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.625681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.630080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32b929-1adb-4eb2-bd90-8157af85c232 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.649332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:56.651140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:56.666449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:56.738304 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 823/1635] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:56.748086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.748769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.749052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.749328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] PATH_INFO: `/v3/projects/7e95ff5583694f35acabe6535930c407/users/ded05daf3a68473cb07aac159f97c1e4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.768447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e95ff5583694f35acabe6535930c407, user_id=ded05daf3a68473cb07aac159f97c1e4, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:56.771428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.785659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.787179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:56.853173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:56.873767 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 813/1636] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:56 2022] PUT /identity/v3/projects/7e95ff5583694f35acabe6535930c407/users/ded05daf3a68473cb07aac159f97c1e4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:56.874828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.874960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd22d-dd7d-4d12-a3c9-5dada30670cf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.942684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.944104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.944790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.945334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.976312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48add93-eed6-44bc-8582-5efd8a8422a3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.994181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.994904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.995298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.995684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.996452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:57.010794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:57.023882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:57.025611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:57.038818 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 824/1637] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:16:57.042205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:57.042686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 814/1638] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:57.054709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513fb97-1364-4d21-92b9-66ab2faeba4b service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:57.062287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:57.063930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:57.064540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:57.064957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] PATH_INFO: `/v3/projects/7e95ff5583694f35acabe6535930c407/users/ded05daf3a68473cb07aac159f97c1e4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:57.067785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e95ff5583694f35acabe6535930c407, user_id=ded05daf3a68473cb07aac159f97c1e4, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:57.072466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af94d-e27f-4579-abb7-3d75a8a64fd4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:57.087210 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 825/1639] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:57 2022] PUT /identity/v3/projects/7e95ff5583694f35acabe6535930c407/users/ded05daf3a68473cb07aac159f97c1e4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:16:58.635822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:58.638304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:58.663405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd880825-5ac2-4085-93be-9cb4abaefffc admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:58.784268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:58.786107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:58.786776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:58.787373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] PATH_INFO: `/v3/projects/3e62884877034740b93cef500446d246` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:58.789801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e62884877034740b93cef500446d246)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:58.791658 dv-cinder-master-3-smb devstack@keystone.service[80509]: WARNING py.warnings [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:58.791658 dv-cinder-master-3-smb devstack@keystone.service[80509]: warnings.warn(msg) Aug 07 01:16:58.791658 dv-cinder-master-3-smb devstack@keystone.service[80509]: Aug 07 01:16:58.793449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:58.970978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:59.005228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e62884877034740b93cef500446d246', 'request_id': 'req-19f55cef-597c-407c-9d10-1d88cd67a4bb'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.021481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e62884877034740b93cef500446d246', 'request_id': 'req-19f55cef-597c-407c-9d10-1d88cd67a4bb'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.044115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e62884877034740b93cef500446d246', 'request_id': 'req-19f55cef-597c-407c-9d10-1d88cd67a4bb'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.149727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] The token cache is being invalidate because project 3e62884877034740b93cef500446d246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:16:59.152441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.152441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-19f55cef-597c-407c-9d10-1d88cd67a4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.156780 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 815/1640] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:58 2022] DELETE /identity/v3/projects/3e62884877034740b93cef500446d246 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:59.157906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:59.158562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:59.158562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:59.195952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:59.197250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:59.370204 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 826/1641] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:59.372002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:59.373095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:59.373221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:59.451086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:59.457770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:59.504759 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 816/1642] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:59.509263 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:59.526881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1af904-82b2-4a6c-baf8-4908776ebecb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:59.555554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:59.557544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:59.557858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:59.558151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:59.561711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:59.562069 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:59.563803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:59.580544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:59.583663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:59.606450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc9a6-1e1a-40e8-8dc0-0110517a37ca None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:59.621286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:59.622281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:59.622763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:59.623230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] PATH_INFO: `/v3/users/51f00971f84945329095ca8b846dfb90` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:59.626221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f00971f84945329095ca8b846dfb90)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:59.628470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:59.632093 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 827/1643] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:59.633198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:59.664122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c4c57-f728-4921-9d20-ea1bef429092 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:59.675090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:59.675940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:59.676106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:59.676490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:59.696847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:59.702717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:59.727656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:59.867052 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 828/1644] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:59 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:59.868022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:59.927168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f00971f84945329095ca8b846dfb90'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:59.944224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f00971f84945329095ca8b846dfb90'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:00.034605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f00971f84945329095ca8b846dfb90'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:00.035349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f00971f84945329095ca8b846dfb90'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:00.046001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8e2cc-1730-48d3-828b-c62de0196057 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.061475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-914dc54c-5cd6-4879-9edf-2d32c26f658d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f00971f84945329095ca8b846dfb90'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:00.065660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.068910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.068910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.068910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.068910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.070241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:00.079064 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 817/1645] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:59 2022] DELETE /identity/v3/users/51f00971f84945329095ca8b846dfb90 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:00.082358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.082725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.083085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.119424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:00.121013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:00.208690 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 818/1646] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:00.227906 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 829/1647] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:59 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:00.235536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:00.235876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:00.238050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:00.239226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:00.253599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238f438-2067-4e1f-99ee-5d920898e041 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.260794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.261700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.262214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.262894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.263777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.268337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:00.290312 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 819/1648] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:00.291550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:00.307415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c009e5-c568-49b3-9506-9c13a2c8092e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.312560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.313797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.314189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.314589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.315901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.318106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:00.339162 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 820/1649] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:00.340484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:00.358936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a8a82-c8d5-4136-b23e-1e17b46b452f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.364574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.365617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.366010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.366322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] PATH_INFO: `/v3/projects/d1ef15c3801e453b8a0eadf0d4679cdd/users/411726c130fb49958466153f37c5e1d8/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.391797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ef15c3801e453b8a0eadf0d4679cdd, user_id=411726c130fb49958466153f37c5e1d8, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.395550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097320-1b3e-4156-b75c-93f9dcd69a90 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:00.399237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96b63-ee72-40f4-91cd-6e6d6728a5f0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.469223 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 821/1650] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:00 2022] PUT /identity/v3/projects/d1ef15c3801e453b8a0eadf0d4679cdd/users/411726c130fb49958466153f37c5e1d8/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:00.491041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.491592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.492481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.532589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] MFA Rules not processed for user `411726c130fb49958466153f37c5e1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:00.534436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:00.537643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.538420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.538756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.538983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.564456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.565967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:00.592579 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 830/1651] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:00.690101 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 822/1652] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:00.695391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:00.712094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8e04-c0a3-40fe-b06d-1ae8fb01d828 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:00.853301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:00.921442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:00.922617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:00.923295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:00.926937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:00.928506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:00.936250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:01.042394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:01.060354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:01.062151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 831/1653] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:00 2022] POST /identity/v3/projects => generated 381 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:01.086065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58dbd6-0488-4f33-8299-bd6832115663 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:01.258580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:01.262275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:01.262275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:01.262275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:01.262275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:01.264058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:01.434696 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 823/1654] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:01 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:01.440240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:01.473431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a37e7d-9586-4589-bade-0917d74c7b87 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:01.499088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:01.500333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:01.503201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:01.503836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:01.505724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:01.516347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:01.550207 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 832/1655] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:01.551278 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:01.574401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee93ae-577a-4501-a214-afa3f805275a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:01.593343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:01.594205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:01.594585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:01.594961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] PATH_INFO: `/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9/users/ce640c21e184478e90b10dd4a093cbc7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:01.637901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=837cd0f5dc374c6f8738963d0b27e1d9, user_id=ce640c21e184478e90b10dd4a093cbc7, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:01.642264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1ed58-d264-43d6-87fb-0dca5e6480fb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:01.789239 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 824/1656] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:01 2022] PUT /identity/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9/users/ce640c21e184478e90b10dd4a093cbc7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:01.793363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:01.805723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e993-f901-44c6-bf7a-ac3034a7689c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:01.861170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:01.861662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:01.862800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:01.905751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] MFA Rules not processed for user `ded05daf3a68473cb07aac159f97c1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:01.907448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:01.952446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:01.953072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:01.953457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:01.953630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:01.954319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:01.955944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:01.995741 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 833/1657] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:01.995741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.011032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.031320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9ac23-8a5d-450a-97df-d9035725d568 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.038269 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 825/1658] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:02.039372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.050616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.051287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.051575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.051963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] PATH_INFO: `/v3/projects/6e84809683e046abb1963435906f5fe9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.053996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e84809683e046abb1963435906f5fe9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.054103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f1c4f-e1d9-4617-83d3-c14c1af8a8b4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.055932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.059189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.059964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.060377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.060921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] PATH_INFO: `/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9/users/ce640c21e184478e90b10dd4a093cbc7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.062785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837cd0f5dc374c6f8738963d0b27e1d9, user_id=ce640c21e184478e90b10dd4a093cbc7, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.065557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9728-4968-4257-a7b8-af82737fead6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.082580 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 826/1659] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:02 2022] PUT /identity/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9/users/ce640c21e184478e90b10dd4a093cbc7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:02.106858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.107405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.107837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.152135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] MFA Rules not processed for user `ce640c21e184478e90b10dd4a093cbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:02.153519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.231471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e84809683e046abb1963435906f5fe9', 'request_id': 'req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:02.245185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e84809683e046abb1963435906f5fe9', 'request_id': 'req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:02.267582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e84809683e046abb1963435906f5fe9', 'request_id': 'req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:02.323365 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 827/1660] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:02.337788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.339381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.400466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] The token cache is being invalidate because project 6e84809683e046abb1963435906f5fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:02.401279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:02.401742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cc179db7-498c-49d7-ba4b-d4052f1f5b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:02.407253 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 834/1661] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:01 2022] DELETE /identity/v3/projects/6e84809683e046abb1963435906f5fe9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:02.412399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8b84-36b5-499b-bd63-fe295b08c6e1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.412837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8b84-36b5-499b-bd63-fe295b08c6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.413328 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8b84-36b5-499b-bd63-fe295b08c6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.447671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3d9c8b84-36b5-499b-bd63-fe295b08c6e1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:02.449286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3d9c8b84-36b5-499b-bd63-fe295b08c6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.491220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:02.494362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c117d74-c8ec-45a0-aab4-528b1420b52d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.527359 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 835/1662] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:02.535512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.535814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.536158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.594306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:02.595562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.619279 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 836/1663] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:02.623912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.640231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.641117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.645348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.645484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282c72-22a2-4a69-8386-0ba28adf5091 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.645583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.645583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.657685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.658379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.658687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.658951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.659611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:02.659925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.665245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.682230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:02.723952 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 837/1664] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:02.734603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.736838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.739310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.763107 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 828/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:02.784274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dd133-50df-4656-8dd5-5e2d0503a52a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.814793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.815624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.816053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.816474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.817268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.819957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.983990 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 838/1666] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:02 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:02.988326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.003014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7cd7e-d6e1-4978-b93b-ac0d87ec670f service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.091342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.091984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.092161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.092444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.093734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.095168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:03.133257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.135920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:03.245223 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 829/1667] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:02 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:03.250003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.266649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a634-5240-4faf-b0f0-dec0d8d0d19d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.273507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3b229-3126-43bc-9716-99a3e113a0a0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.290987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.293302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.294258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.294545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.298631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.299248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.300086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.300408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.301543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.303715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:03.307194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:03.332671 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 830/1668] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:03.343866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.371203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd9ed-df4d-4bab-9116-880f048164ab admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.378544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.379635 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.381041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.381495 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.382762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.384685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:03.409873 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 831/1669] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:03.424417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.428365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.429962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ae4e-4380-4ffa-9430-6f3c60285abb service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:03.444322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f248df-efe7-4fe5-8f59-9f8753a4439f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.449744 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 839/1670] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:03.451155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.451961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.452646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.453035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] PATH_INFO: `/v3/projects/aa7421c8f5c74fc4a617771b2791c330/users/3f6e1f68d1004cf88780dedf573a535d/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.474461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7421c8f5c74fc4a617771b2791c330, user_id=3f6e1f68d1004cf88780dedf573a535d, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.478986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:03.574525 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 832/1671] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:03 2022] PUT /identity/v3/projects/aa7421c8f5c74fc4a617771b2791c330/users/3f6e1f68d1004cf88780dedf573a535d/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:03.575839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.576320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.576611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.625701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] MFA Rules not processed for user `3f6e1f68d1004cf88780dedf573a535d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:03.628043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:03.776742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:03.780652 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 840/1672] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:03.932714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784723cf-25f2-46ba-93c6-c2e3e5011acd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:03.955862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:03.956533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:03.960419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:03.960419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:03.966000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:03.968599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:04.007578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:04.010218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:04.055581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4f4df-f93f-41f9-8f3d-faeac8f70edb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:04.070670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:04.073671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.074010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.074339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] PATH_INFO: `/v3/users/05dae98109b14ac7a5b4bcaaeb17e00c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.076394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05dae98109b14ac7a5b4bcaaeb17e00c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:04.082627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:04.099480 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 833/1673] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:03 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:04.107688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:04.345194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05dae98109b14ac7a5b4bcaaeb17e00c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.349001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085d91e-bb33-4a88-8123-a8e35d44590a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:04.358585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:04.359243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.359520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.359792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.360492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:04.362921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:04.400074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:04.429100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05dae98109b14ac7a5b4bcaaeb17e00c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.445128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05dae98109b14ac7a5b4bcaaeb17e00c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.445932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05dae98109b14ac7a5b4bcaaeb17e00c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.478352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05dae98109b14ac7a5b4bcaaeb17e00c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.479802 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 834/1674] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:04 2022] POST /identity/v3/users => generated 300 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:04.484839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:04.490082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:04.497224 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 841/1675] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:04 2022] DELETE /identity/v3/users/05dae98109b14ac7a5b4bcaaeb17e00c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:04.498708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:04.503803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:04.553277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be3876-f426-4b7b-8285-c04e1939e544 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:04.658917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:04.659873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.660389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.660389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] PATH_INFO: `/v3/users/a7057a0481a54dbabd5451f2ff7c498e` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.661686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7057a0481a54dbabd5451f2ff7c498e)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:04.664587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:04.708616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e54-735b-4d3e-a7c6-20ed87829110 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:04.729689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:04.730568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.730996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.731438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.732398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:04.734205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d0a7-4293-42b7-b4bb-1ec90a77fbc2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:04.750109 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 842/1676] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:04.751997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b4e1-aa9d-4d9a-8a64-f5fa33e1fba5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.752471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b4e1-aa9d-4d9a-8a64-f5fa33e1fba5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.768153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b4e1-aa9d-4d9a-8a64-f5fa33e1fba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.837942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7ce5b4e1-aa9d-4d9a-8a64-f5fa33e1fba5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:04.841809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7ce5b4e1-aa9d-4d9a-8a64-f5fa33e1fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:04.870151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 843/1677] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:04.871870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f29baa-34a6-4fb1-bebc-2d9e9a481aaa None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.872163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f29baa-34a6-4fb1-bebc-2d9e9a481aaa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.872513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f29baa-34a6-4fb1-bebc-2d9e9a481aaa None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.874286 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 844/1678] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:04.875245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f29baa-34a6-4fb1-bebc-2d9e9a481aaa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:04.917077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f29baa-34a6-4fb1-bebc-2d9e9a481aaa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:04.921545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7057a0481a54dbabd5451f2ff7c498e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:04.928129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:04.929268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:04.929268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:04.929495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] PATH_INFO: `/v3/projects/77f30f45787b4106bb0f0617091c996f/users/6bf49bbd5da847dbb25ad7b811e20a76/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:04.960881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7057a0481a54dbabd5451f2ff7c498e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:05.007650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f30f45787b4106bb0f0617091c996f, user_id=6bf49bbd5da847dbb25ad7b811e20a76, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.010736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c3806-9a95-4432-9ad5-dc35a7f3063a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.081209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7057a0481a54dbabd5451f2ff7c498e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:05.082353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7057a0481a54dbabd5451f2ff7c498e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:05.106885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7057a0481a54dbabd5451f2ff7c498e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:05.116288 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 845/1679] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:04 2022] PUT /identity/v3/projects/77f30f45787b4106bb0f0617091c996f/users/6bf49bbd5da847dbb25ad7b811e20a76/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:05.118994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.119799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.120878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.121005 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 835/1680] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:04 2022] DELETE /identity/v3/users/a7057a0481a54dbabd5451f2ff7c498e => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:05.121977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.126925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.172689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.194750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:05.197372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.343317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801345b0-7fd5-4a65-816e-b62474a1dcb6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.357580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.361164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.362189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.363287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.376461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.405458 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 846/1681] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:05.408746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.411481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.543104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.547273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859fbe-88fa-49b2-bdf6-5ba67ddbd122 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.579018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ccd7f-86c8-4add-a81d-69926521925d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.583931 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 836/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:05.587546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a18c9-aece-4505-9e6e-e037019b14db None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.588546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a18c9-aece-4505-9e6e-e037019b14db None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.589485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a18c9-aece-4505-9e6e-e037019b14db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.594285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.595483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.596164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.596883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.598791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.606317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.633114 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 847/1683] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:05.636262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.642550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-984a18c9-aece-4505-9e6e-e037019b14db None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.647766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-984a18c9-aece-4505-9e6e-e037019b14db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.661590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb73b2-984a-4a73-a380-0666497055c2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.673999 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 837/1684] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:05.681051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.682808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.684080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.685509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] PATH_INFO: `/v3/projects/77f30f45787b4106bb0f0617091c996f/users/6bf49bbd5da847dbb25ad7b811e20a76/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.692915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f30f45787b4106bb0f0617091c996f, user_id=6bf49bbd5da847dbb25ad7b811e20a76, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.700797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66d732-7be9-4097-82fd-822b2b62cfcd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.733108 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 848/1685] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:05 2022] PUT /identity/v3/projects/77f30f45787b4106bb0f0617091c996f/users/6bf49bbd5da847dbb25ad7b811e20a76/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:05.746298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.746613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.746897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.814801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f0d7-f210-422c-8180-4961739d86b2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.815097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f0d7-f210-422c-8180-4961739d86b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.815650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f0d7-f210-422c-8180-4961739d86b2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.819070 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 849/1686] 10.222.0.36 () {54 vars in 961 bytes} [Sun Aug 7 01:17:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:17:05.825999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.827643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.828072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.865472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:05.868727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] MFA Rules not processed for user `6bf49bbd5da847dbb25ad7b811e20a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.870006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.905093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.906806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:06.151380 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 850/1687] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:06.152666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:06.160049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:06.161362 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 838/1688] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:06.174568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:06.179590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:06.327729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:06.393097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d787c-3e0c-4f87-a46c-8bca6039cac1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:06.410246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:06.416691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:06.416691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:06.416691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:06.449389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b916c1-d0db-4f17-b688-92b784a2b19a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:06.459914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:06.460551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:06.463658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:06.463928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:06.505448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:06.513217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:06.568577 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 839/1689] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:06.571450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:06.639675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77456f4-c512-4c7e-bbc9-c2a41f88d898 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:06.655287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:06.656044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:06.656341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:06.656619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:06.704127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:06.710281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:06.712596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:06.713176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe20610-fb7a-4786-ac90-921a36effd3c service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:06.739226 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 851/1690] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:06.741121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:06.752995 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 840/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:06.754531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:06.754820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:06.755102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:06.760222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035d7b-22a6-492e-b492-b95ebe94afb1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:06.773891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:06.775096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:06.776488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:06.777125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] PATH_INFO: `/v3/users/3f6e1f68d1004cf88780dedf573a535d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:06.779252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6e1f68d1004cf88780dedf573a535d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:06.782220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:06.861542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] MFA Rules not processed for user `f270593db29b4835952de74f591011c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:06.873267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.034657 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 841/1692] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:07.035616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:07.039579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.068227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6e1f68d1004cf88780dedf573a535d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.085687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ede6-0255-44ee-90ae-473ed43b2c83 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:07.095486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:07.096754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.097102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.097444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] PATH_INFO: `/v3/projects/fc3a83aac14941e0b7ac06feccc04b5e` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.100218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3a83aac14941e0b7ac06feccc04b5e)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:07.106591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:07.149754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:07.187395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6e1f68d1004cf88780dedf573a535d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.199845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6e1f68d1004cf88780dedf573a535d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.201910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6e1f68d1004cf88780dedf573a535d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.231641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f382ec42-77bd-4e0c-a5cb-9a5ec79147d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6e1f68d1004cf88780dedf573a535d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.245404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3a83aac14941e0b7ac06feccc04b5e', 'request_id': 'req-d17c4c10-6e89-4b88-8479-f98a42de18f4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.247293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 852/1693] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:06 2022] DELETE /identity/v3/users/3f6e1f68d1004cf88780dedf573a535d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:07.249311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791339a-cd13-4e40-96e0-0b61adbf4172 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.249439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791339a-cd13-4e40-96e0-0b61adbf4172 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.251609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791339a-cd13-4e40-96e0-0b61adbf4172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.263960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3a83aac14941e0b7ac06feccc04b5e', 'request_id': 'req-d17c4c10-6e89-4b88-8479-f98a42de18f4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.281824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3a83aac14941e0b7ac06feccc04b5e', 'request_id': 'req-d17c4c10-6e89-4b88-8479-f98a42de18f4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.305150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0791339a-cd13-4e40-96e0-0b61adbf4172 None None] MFA Rules not processed for user `f270593db29b4835952de74f591011c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:07.308271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0791339a-cd13-4e40-96e0-0b61adbf4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.398878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] The token cache is being invalidate because project fc3a83aac14941e0b7ac06feccc04b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:07.399235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.401899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d17c4c10-6e89-4b88-8479-f98a42de18f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:07.404015 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 842/1694] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:07 2022] DELETE /identity/v3/projects/fc3a83aac14941e0b7ac06feccc04b5e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:07.405275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87c8f-8cd8-40c3-8f36-3bc77e0c59a4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.405565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87c8f-8cd8-40c3-8f36-3bc77e0c59a4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.407462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87c8f-8cd8-40c3-8f36-3bc77e0c59a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.412643 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 853/1695] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:07.414162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.414466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.414733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.475464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-11c87c8f-8cd8-40c3-8f36-3bc77e0c59a4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:07.475694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:07.477170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-11c87c8f-8cd8-40c3-8f36-3bc77e0c59a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.478407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.576546 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 854/1696] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:07.589621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:07.596295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.624766 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 843/1697] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:07.624766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.624766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.624766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.672838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:07.678969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.701624 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 844/1698] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:07.702968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:07.708145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.841764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbddc36-3f1c-4b2d-9ce8-1a9784b3394b None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:07.858716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:07.860386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.860881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.861361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.888855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:07.890801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:07.892537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53fd70-f9dd-4d0a-ab4b-640b332300f3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:07.911213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:07.912232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.912697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.913497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.915572 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 845/1699] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:07.915869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:07.916571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:07.932277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ca40-39fa-49af-aeba-a684813b20b3 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:07.939062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:07.941402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:07.947569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:07.949668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:07.950715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:07.951184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:07.952511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:07.953068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:07.956674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:07.976808 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 855/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:08.006810 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 846/1701] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:08.010919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:08.022911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a7f27-995d-4f83-9b38-1a977fff539d service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:08.029081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:08.029081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.029081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.029081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.029649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:08.032316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:08.189268 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 856/1702] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:08 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:08.191218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:08.215202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb797f-ca41-4dec-b129-39d66128cff0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:08.309755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:08.310575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.311009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.311421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.312306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:08.315294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:08.443935 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 847/1703] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:08 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:08.448065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:08.463552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636daa-4acf-49dc-8ff1-fec57d507c52 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:08.474388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:08.475267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.475719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.476299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.477099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:08.479217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:08.511893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:08.512874 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 857/1704] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:08.525687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053f2f6-d7f2-4239-9648-bd2e017be184 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:08.540068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:08.540895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.541423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.541819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.542618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:08.543190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:08.544437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d968d9-5fda-442f-93dd-f6cdaac64ebb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:08.570737 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 848/1705] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:08.572375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:08.591819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144dbab-32c9-4250-bd11-8227e89ef751 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:08.602060 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:08.603386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.603608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.603890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] PATH_INFO: `/v3/projects/3ee1fe6864314b15aaf4d31ea2ed17c0/users/3683cdabdec841c88d0b42cf3c838eb2/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.627113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1fe6864314b15aaf4d31ea2ed17c0, user_id=3683cdabdec841c88d0b42cf3c838eb2, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:08.630063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cdc80-3a54-49b6-b4ae-67cd7b630411 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:08.700648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668f67-ebe2-453b-b278-9a2d507277e8 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.701201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668f67-ebe2-453b-b278-9a2d507277e8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.701483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668f67-ebe2-453b-b278-9a2d507277e8 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.710427 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 849/1706] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:17:08.730264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.730560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.730843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.770989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] MFA Rules not processed for user `f23e2e7e9bb442b9a76fb6c47b35d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:08.774837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:08.789171 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 858/1707] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:08 2022] PUT /identity/v3/projects/3ee1fe6864314b15aaf4d31ea2ed17c0/users/3683cdabdec841c88d0b42cf3c838eb2/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:08.806800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1f16-3b35-4f5a-b889-6087b5beb57c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:08.810560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1f16-3b35-4f5a-b889-6087b5beb57c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:08.811595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f1f16-3b35-4f5a-b889-6087b5beb57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:08.897815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ed0f1f16-3b35-4f5a-b889-6087b5beb57c None None] MFA Rules not processed for user `3683cdabdec841c88d0b42cf3c838eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:08.900952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ed0f1f16-3b35-4f5a-b889-6087b5beb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:08.965779 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 850/1708] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:09.007027 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 859/1709] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:09.014743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.016110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.108773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.109536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.110604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.113714 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 860/1710] 10.222.0.36 () {54 vars in 912 bytes} [Sun Aug 7 01:17:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:09.120834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.123433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.128376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6de1a-ba97-4b11-bb88-7691813a5752 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:09.140412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:09.141150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.141702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.142036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.157506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:09.160840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681198-2a06-4d8c-81c6-936e2d5ef73a service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:09.173490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826c91-5d47-4241-b7ed-84665a4dd933 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:09.185906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:09.187597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.188568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.189313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.195635 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 851/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:09.198576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.199550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.210340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.213014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:09.216060 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:09.221957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:09.245156 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 861/1712] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:09.247595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.251462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.333398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:09.335383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.351553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e87b6-bc7c-42c1-8b76-5ae20159d85d service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:09.363055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:09.364063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.364353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.369316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] PATH_INFO: `/v3/projects/d9d7dbe4684843fcaa03f9f1d571c9f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.369316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d7dbe4684843fcaa03f9f1d571c9f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:09.370858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:09.389062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:09.462154 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 852/1713] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:09.463124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.464467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.484372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792158b-641a-434a-aa76-592fc6ff5112 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:09.492616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:09.493359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.493717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.494690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] PATH_INFO: `/v3/users/825a37a0e63c423da11273406e8b02f1` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.496950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=825a37a0e63c423da11273406e8b02f1)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:09.500144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:09.542969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d7dbe4684843fcaa03f9f1d571c9f9', 'request_id': 'req-52a91b0e-fb9b-405e-83e8-385c1766e3ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.548745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d7dbe4684843fcaa03f9f1d571c9f9', 'request_id': 'req-52a91b0e-fb9b-405e-83e8-385c1766e3ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.556525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d7dbe4684843fcaa03f9f1d571c9f9', 'request_id': 'req-52a91b0e-fb9b-405e-83e8-385c1766e3ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.647363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] The token cache is being invalidate because project d9d7dbe4684843fcaa03f9f1d571c9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:09.647662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.648717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.651470 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 862/1714] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:09 2022] DELETE /identity/v3/projects/d9d7dbe4684843fcaa03f9f1d571c9f9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:09.656142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.658208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.762241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825a37a0e63c423da11273406e8b02f1'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.777793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a91b0e-fb9b-405e-83e8-385c1766e3ab admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:09.781721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825a37a0e63c423da11273406e8b02f1'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.790703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:09.791684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:09.791980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:09.792309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] PATH_INFO: `/v3/projects/aa7421c8f5c74fc4a617771b2791c330` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:09.793475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7421c8f5c74fc4a617771b2791c330)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:09.797053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:09.852035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825a37a0e63c423da11273406e8b02f1'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.853127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825a37a0e63c423da11273406e8b02f1'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.881197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825a37a0e63c423da11273406e8b02f1'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.903105 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 853/1715] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:09 2022] DELETE /identity/v3/users/825a37a0e63c423da11273406e8b02f1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:09.908585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:09.913797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:09.938878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7421c8f5c74fc4a617771b2791c330', 'request_id': 'req-ab1ac817-3c6e-4e4b-9814-0490de18979d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.953357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7421c8f5c74fc4a617771b2791c330', 'request_id': 'req-ab1ac817-3c6e-4e4b-9814-0490de18979d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:09.966377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7421c8f5c74fc4a617771b2791c330', 'request_id': 'req-ab1ac817-3c6e-4e4b-9814-0490de18979d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.049262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] The token cache is being invalidate because project aa7421c8f5c74fc4a617771b2791c330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:10.049262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.050272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ab1ac817-3c6e-4e4b-9814-0490de18979d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.052360 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 863/1716] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:09 2022] DELETE /identity/v3/projects/aa7421c8f5c74fc4a617771b2791c330 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:10.055219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd58e-c2ea-48a8-b019-660dbd11e6e3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.055591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd58e-c2ea-48a8-b019-660dbd11e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.055944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd58e-c2ea-48a8-b019-660dbd11e6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.102248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08608c-ec46-4b5b-9195-276c7705b5fb admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.113518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e8efd58e-c2ea-48a8-b019-660dbd11e6e3 None None] MFA Rules not processed for user `598402f6609c422cbcc0dd0bfae53430`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:10.115452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e8efd58e-c2ea-48a8-b019-660dbd11e6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.288192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.291317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.291317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.291494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.300675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.313976 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 864/1717] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:10.313976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.313976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.313976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.324883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.327840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff699c-93b7-4642-9409-6a5b7c1204a9 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.347234 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 854/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:10.352156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.356869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.356869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.376232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] MFA Rules not processed for user `4c8389683e844b989fe5cbe779327933`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:10.378770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.379388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:10.382343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.532336 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 855/1719] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:10.533796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:10.535487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.551877 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 865/1720] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:10.561014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:10.563256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.576818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0b244-29c7-4b33-b57e-4f4094eb0a5d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.595985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:10.595985 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.597715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.598052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.598340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] PATH_INFO: `/v3/users/6bf49bbd5da847dbb25ad7b811e20a76` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.600027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf49bbd5da847dbb25ad7b811e20a76)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.604490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.714532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc13d-ee46-49c7-944b-230f2500fdfc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.720003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.720616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.720901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.721169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.730461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.732085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.743712 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 866/1721] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:10.744562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:10.745939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.773956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5b359-3f74-42ad-a02a-f9c6bc0f02ec service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.796980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.798541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.799781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.800062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] PATH_INFO: `/v3/projects/0abd0ab6a2794a0a80f8581e9fbde1da` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.803812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abd0ab6a2794a0a80f8581e9fbde1da)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.807540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.902749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf49bbd5da847dbb25ad7b811e20a76'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.918354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf49bbd5da847dbb25ad7b811e20a76'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.963516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abd0ab6a2794a0a80f8581e9fbde1da', 'request_id': 'req-1619e932-abb0-4cd8-8683-c0ec929f3ba8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.969320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abd0ab6a2794a0a80f8581e9fbde1da', 'request_id': 'req-1619e932-abb0-4cd8-8683-c0ec929f3ba8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.981349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abd0ab6a2794a0a80f8581e9fbde1da', 'request_id': 'req-1619e932-abb0-4cd8-8683-c0ec929f3ba8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.003247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf49bbd5da847dbb25ad7b811e20a76'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.005404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf49bbd5da847dbb25ad7b811e20a76'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.026577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16d6f9eb-7baa-4cda-96ff-830f07c0d3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf49bbd5da847dbb25ad7b811e20a76'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.033670 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 856/1722] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:10 2022] DELETE /identity/v3/users/6bf49bbd5da847dbb25ad7b811e20a76 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:11.035108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.035372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.035654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.084651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:11.086216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.090960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] The token cache is being invalidate because project 0abd0ab6a2794a0a80f8581e9fbde1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:11.091529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.093121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.099409 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 867/1723] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:10 2022] DELETE /identity/v3/projects/0abd0ab6a2794a0a80f8581e9fbde1da => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:11.100614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.102221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.257487 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 857/1724] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:11.258492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.265123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.278732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619e932-abb0-4cd8-8683-c0ec929f3ba8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.300337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5c80-0bb9-4048-bca8-d7fcb740fef1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.323818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.325116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.326342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.327238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] PATH_INFO: `/v3/users/ded05daf3a68473cb07aac159f97c1e4` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.333756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded05daf3a68473cb07aac159f97c1e4)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.337010 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.430842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.432127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.434441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.434581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.440067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.572518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.573981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.588638 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 868/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:11.589515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.617495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88e747-5abd-431e-ab47-f11de3639be5 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.623335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.624407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.624833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.625133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.625806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:11.626577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.628466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.654136 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 869/1726] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:11.655100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.656890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.703073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded05daf3a68473cb07aac159f97c1e4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.728142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded05daf3a68473cb07aac159f97c1e4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.791365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289c5b-0ef8-48d3-8f47-a5426b88ae4e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.797024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.797791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.798197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.798564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.800840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.815264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.817178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.830033 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 870/1727] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:11.831179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.843705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded05daf3a68473cb07aac159f97c1e4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.844444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7d324-4e1c-47da-8589-c4cf57db2ae4 service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.845861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded05daf3a68473cb07aac159f97c1e4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.852927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.852927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.852927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.853678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.854495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.856750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.892532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded05daf3a68473cb07aac159f97c1e4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.904206 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 858/1728] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:11 2022] DELETE /identity/v3/users/ded05daf3a68473cb07aac159f97c1e4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:11.905548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.922671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:12.012035 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 871/1729] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:11 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:12.016158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.027709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:12.137322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c135-1066-4e15-9021-b353bf18fc79 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.137535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:12.242433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a982b-ab7f-43a7-9688-af0f333a4e2c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.264622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.267526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.269103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.269598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.271469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.274390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.314227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.314899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.315187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.315469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] PATH_INFO: `/v3/projects/77f30f45787b4106bb0f0617091c996f` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.318356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f30f45787b4106bb0f0617091c996f)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.320498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.368318 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 872/1730] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:12 2022] POST /identity/v3/users => generated 286 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:12.373522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.393744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2af2ac-41b4-42bb-82c1-82a103628904 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.404318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.404947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.405265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.405550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.406267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.407939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.435941 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 873/1731] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:12.439818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.508330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc5ff-eca7-4de4-8f42-90336e31fb14 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.525015 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.525743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.526057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.526333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.526985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.528685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.566289 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 874/1732] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:12.567356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.576016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:12.593494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f30f45787b4106bb0f0617091c996f', 'request_id': 'req-63c5842c-533d-42f8-a074-f6777f10ebc0'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.605757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f30f45787b4106bb0f0617091c996f', 'request_id': 'req-63c5842c-533d-42f8-a074-f6777f10ebc0'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.622002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f30f45787b4106bb0f0617091c996f', 'request_id': 'req-63c5842c-533d-42f8-a074-f6777f10ebc0'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.629223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510b9d-e6ae-4c95-823b-45cbb1a89c30 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.763964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.764617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.764902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.765208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] PATH_INFO: `/v3/projects/7e95ff5583694f35acabe6535930c407` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.766551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e95ff5583694f35acabe6535930c407)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.772903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.815600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] The token cache is being invalidate because project 77f30f45787b4106bb0f0617091c996f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:12.816071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.819443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.828436 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 859/1733] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:11 2022] DELETE /identity/v3/projects/77f30f45787b4106bb0f0617091c996f => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:12.829478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.839497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:12.861170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5842c-533d-42f8-a074-f6777f10ebc0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.868758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.870079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.870545 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.870971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] PATH_INFO: `/v3/projects/cf34c97172ed4eb7998b79636e604d72/users/36f1155ddd0045beb4bc0d9cc9084b12/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.906350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf34c97172ed4eb7998b79636e604d72, user_id=36f1155ddd0045beb4bc0d9cc9084b12, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.909242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d787ce-0426-44eb-abb8-955e4afa93f9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.022095 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 860/1734] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:12 2022] PUT /identity/v3/projects/cf34c97172ed4eb7998b79636e604d72/users/36f1155ddd0045beb4bc0d9cc9084b12/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:13.022095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75e46-3c30-4403-9508-71a934ab4325 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.022095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75e46-3c30-4403-9508-71a934ab4325 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.022095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75e46-3c30-4403-9508-71a934ab4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.030557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e95ff5583694f35acabe6535930c407', 'request_id': 'req-71473ea5-86de-4e50-97e3-8d5f8419504c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:13.040960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e95ff5583694f35acabe6535930c407', 'request_id': 'req-71473ea5-86de-4e50-97e3-8d5f8419504c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:13.053015 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e95ff5583694f35acabe6535930c407', 'request_id': 'req-71473ea5-86de-4e50-97e3-8d5f8419504c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:13.056487 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-73a75e46-3c30-4403-9508-71a934ab4325 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:13.062830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-73a75e46-3c30-4403-9508-71a934ab4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.150677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] The token cache is being invalidate because project 7e95ff5583694f35acabe6535930c407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:13.150979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:13.157036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71473ea5-86de-4e50-97e3-8d5f8419504c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:13.167829 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 875/1735] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:12 2022] DELETE /identity/v3/projects/7e95ff5583694f35acabe6535930c407 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:13.170048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.170351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.170639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.255580 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 861/1736] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:13.267285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af33d-f822-4e59-8381-9eb27b217698 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.267690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af33d-f822-4e59-8381-9eb27b217698 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.267974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af33d-f822-4e59-8381-9eb27b217698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.277407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] MFA Rules not processed for user `36f1155ddd0045beb4bc0d9cc9084b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:13.281156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.319650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ee7af33d-f822-4e59-8381-9eb27b217698 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:13.329759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ee7af33d-f822-4e59-8381-9eb27b217698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.356279 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 862/1737] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:13.360065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbef89-d509-4b8c-a3fb-0e477bcd5720 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.360361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbef89-d509-4b8c-a3fb-0e477bcd5720 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.360634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbef89-d509-4b8c-a3fb-0e477bcd5720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.414669 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c5bbef89-d509-4b8c-a3fb-0e477bcd5720 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:13.415975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c5bbef89-d509-4b8c-a3fb-0e477bcd5720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.438536 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 863/1738] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:13.441037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.443022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.443022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.461394 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 876/1739] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:13.467688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.477647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:13.479153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.482256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed35b3-e6d4-4a04-a1d3-ecb3f551c88a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.489866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.491336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.496068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.496068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.496068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:13.496068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.496783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.507328 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 864/1740] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:13.508360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.513760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.514709 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 877/1741] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:13.515778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.528700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fbcc3-360d-4b44-b09f-7fb9f3bab543 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.542582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.551728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.553311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.554197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.556181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:13.556505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.563620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.600126 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 878/1742] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:13.601353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.611901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51294f-9e8e-4f80-84bc-9a9efd5aae3f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.618345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.627304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.627304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.627304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.627304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.627304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.641766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa629485-53ea-4666-a809-2d7ff689ddc3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.646559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.647397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.647742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.648032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.658972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.659382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.670245 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 865/1743] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:13.671055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.682952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d98da-eca5-469e-a201-7beafb874cc9 service glance] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.688900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.690491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.690491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.690767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.691632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.694100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:13.756592 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 879/1744] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:13.760458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.815699 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 866/1745] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:13.820728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.850259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:13.898451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5e2c6-4517-460c-b88a-6e62d5d1cb50 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.045571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b590924-5b60-4171-8e5a-fba33500c938 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.061508 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.062179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.062471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.062758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.063385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.064974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.065553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.065895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.066328 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.066702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.069507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.075624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.234550 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 880/1746] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/users => generated 292 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:14.236464 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 867/1747] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:13 2022] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:14.240561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.241908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.260870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b372-3ffc-4a95-9785-a4b795a5597b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.263629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235798-f07e-40b1-92ad-596a730c36c8 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.273581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.274233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.274997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.275614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.275892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.276181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.276818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.278625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.278931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.279795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.281407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.283327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.310585 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 881/1749] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:14.311844 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 868/1749] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:14.312782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.313578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.333955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6d45-e179-4a20-89b8-9dcc33a735af admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.336403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411eab7b-0da0-4716-9dad-5137bc7494fb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.345974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.346852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.346852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.347858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.348504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.349759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.350064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.350718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.351675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.352408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.354059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.356394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.382651 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 869/1750] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:14.384279 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 882/1751] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:14.385365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.386732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.399888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:14.408137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff9044-cb25-48be-8c3f-15df11743de7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.412108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbfa6-fc5b-427b-b85d-02d8ccb14e2f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.429445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.430156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.430443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.430716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] PATH_INFO: `/v3/projects/f0e2f615b5b5430ca5a04617c832cc6e/users/82f52e4645a84e5cbcfa92a222651040/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.440387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.441064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.441349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.441624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] PATH_INFO: `/v3/projects/59fd9ef3c9b7439486c69e6d5acf262a/users/99b15f39b3344f67a1cf776698ad4f45/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.488221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fd9ef3c9b7439486c69e6d5acf262a, user_id=99b15f39b3344f67a1cf776698ad4f45, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.491336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fa6a3-16e8-478a-8455-72f07ee3688e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.498231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e2f615b5b5430ca5a04617c832cc6e, user_id=82f52e4645a84e5cbcfa92a222651040, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.511383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaf4ef-70ec-40e5-a7df-1d45bd0ad3a6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.601280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 870/1752] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:14 2022] PUT /identity/v3/projects/59fd9ef3c9b7439486c69e6d5acf262a/users/99b15f39b3344f67a1cf776698ad4f45/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:14.618323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.619089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.619609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.668100 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 883/1753] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:14 2022] PUT /identity/v3/projects/f0e2f615b5b5430ca5a04617c832cc6e/users/82f52e4645a84e5cbcfa92a222651040/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:14.681452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.681984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.682785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.692214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] MFA Rules not processed for user `99b15f39b3344f67a1cf776698ad4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:14.706387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:14.726830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] MFA Rules not processed for user `82f52e4645a84e5cbcfa92a222651040`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:14.729928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:14.898462 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 871/1754] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:14.910688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.933162 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 884/1755] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:14.938109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.094121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913fa2-73e7-4b1f-aa2d-ca2f04b03c3d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.136994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.138158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.138722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.139170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.139997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.144967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.169986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22a71-3085-49f5-b34f-dc1e0421cd49 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.192055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.196148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.196521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.196806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.200519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.207546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.326018 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 872/1756] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/projects => generated 383 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:15.326018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.328013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:15.381338 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 885/1757] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/projects => generated 375 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:15.382334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.485076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59f81c-4c8d-4255-82ce-748c6da5438d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.590509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472beb7-22ea-499f-a105-1bb08f3ba6d0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.598234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.599879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.600563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.601101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.602250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.607524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.624395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.625950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.625950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.626131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] PATH_INFO: `/v3/users/411726c130fb49958466153f37c5e1d8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.637084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=411726c130fb49958466153f37c5e1d8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.647594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.722368 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 886/1758] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/users => generated 298 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:15.723206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.744324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330fe12-11ca-402c-88ac-799f66017f0d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.756290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.757318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.757739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.758196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.759542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.761960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6483a1-76e4-469c-8a63-1a39740a1f28 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.988977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:15.998056 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 887/1759] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:15.999327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.999613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.999886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.009946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411726c130fb49958466153f37c5e1d8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:16.020182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411726c130fb49958466153f37c5e1d8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:16.044047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] MFA Rules not processed for user `598402f6609c422cbcc0dd0bfae53430`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:16.045310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.102180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411726c130fb49958466153f37c5e1d8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:16.102828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411726c130fb49958466153f37c5e1d8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:16.124019 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 888/1760] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:16.124019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.124267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e3947512-38e9-4fd0-b398-166fec11ddfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411726c130fb49958466153f37c5e1d8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:16.124339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.124405 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 873/1761] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:15 2022] DELETE /identity/v3/users/411726c130fb49958466153f37c5e1d8 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:16.127805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.127805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.132448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.137099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51156c6-4696-415e-97ec-d5165ed3779f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.217714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:16.219565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.239926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.240579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.240863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.241145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.241853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.243547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.257640 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 889/1762] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.258697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.266166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.277020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e253f61-d36b-4b20-be9e-dafd55d9aefc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.282274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.283660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.283660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.283660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.284677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.286642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6ab62-15e5-4324-9b35-a59a13dbdb45 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.299639 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 890/1763] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.300992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.301289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.301619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.308394 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 874/1764] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:16.309091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.322540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f75028-d539-426c-b286-268ec5fad8a4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.329635 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.330560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.330995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.331587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] PATH_INFO: `/v3/projects/cdcf47626595483285db4ccd2626cbe8/users/95a6540f6f21490fa5c98c88743d7166/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.350604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:16.351976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.353881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf47626595483285db4ccd2626cbe8, user_id=95a6540f6f21490fa5c98c88743d7166, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.355874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.361759 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 891/1765] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:16.362932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.374007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358953-ddaf-4c9d-a12e-221edeb1f137 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.385450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.386258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.386538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.388580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] PATH_INFO: `/v3/projects/f350284549ce4f8eb40ade452694e45f/users/3b9b0b7aa98d4e14826bc9f997eb89c4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.403497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f350284549ce4f8eb40ade452694e45f, user_id=3b9b0b7aa98d4e14826bc9f997eb89c4, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.406805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.417786 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 875/1766] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/cdcf47626595483285db4ccd2626cbe8/users/95a6540f6f21490fa5c98c88743d7166/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:16.420977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.422323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.483989 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 892/1767] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/f350284549ce4f8eb40ade452694e45f/users/3b9b0b7aa98d4e14826bc9f997eb89c4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:16.484887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.521216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b90da-5892-499a-8d8c-fa8c017bef17 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.588043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1defc6-dd4d-46f5-a344-c981d07a745b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.610043 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.610962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.611241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.611520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.612284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.615301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.633791 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 893/1768] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.645180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.657000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.657633 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.658062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.658341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.662666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aa5e0-1997-4dee-bcaf-95b0a5c45d35 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.668322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.670550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.681023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.681023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.681023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.681023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8903-6aa3-457f-9f1c-f90e537611ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.693534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.694280 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 894/1769] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.695286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.695943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.696238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.696539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.715412 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 876/1770] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:16.716273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.727802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] MFA Rules not processed for user `4c8389683e844b989fe5cbe779327933`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:16.729798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.742659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6df0-7df4-4191-b827-09c19d0c746c service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.760658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.761374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.761682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.762341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] PATH_INFO: `/v3/projects/cdcf47626595483285db4ccd2626cbe8/users/95a6540f6f21490fa5c98c88743d7166/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.769473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf47626595483285db4ccd2626cbe8, user_id=95a6540f6f21490fa5c98c88743d7166, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.775299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.817600 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 895/1771] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:16.819089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.820181 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 877/1772] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/cdcf47626595483285db4ccd2626cbe8/users/95a6540f6f21490fa5c98c88743d7166/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:16.821234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.821345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.044252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93cb1e-c0d7-4708-883a-8a8a553bc6cf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.058040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dda3f-7777-4aee-ae2e-ee3faa9a1279 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.073403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.074470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.076188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.077163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] PATH_INFO: `/v3/projects/f350284549ce4f8eb40ade452694e45f/users/3b9b0b7aa98d4e14826bc9f997eb89c4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.079828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f350284549ce4f8eb40ade452694e45f, user_id=3b9b0b7aa98d4e14826bc9f997eb89c4, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.115412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4575a02-2acd-4c6f-803e-ff21ccca18b1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.115412 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 878/1773] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/f350284549ce4f8eb40ade452694e45f/users/3b9b0b7aa98d4e14826bc9f997eb89c4/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:17.115412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.115412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.115412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.148431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] MFA Rules not processed for user `95a6540f6f21490fa5c98c88743d7166`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:17.149641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.150125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.150595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.151042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.151318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.249743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.251629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13235c-bc59-452a-b327-f7d3dabb9fc7 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.270604 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 896/1774] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:17.272741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.279766 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 879/1775] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:17.296086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.298339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.299540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.301058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.397317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] MFA Rules not processed for user `3b9b0b7aa98d4e14826bc9f997eb89c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:17.398621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.462020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282c35a-9ac1-483f-ad99-16125e51a042 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.468888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.470785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.470785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.470785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.481567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.483174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.504317 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 880/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:17.636076 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 897/1777] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:17.645722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.679728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953110be-835f-477d-ba0c-bac6002428c1 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.689719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.693119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.695689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.699836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.699836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.699836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.702001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.710516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124c03e-6fe3-463b-b183-40b44cd60cb8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.714647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.715267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.715550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.715951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.717975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.867645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.869262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.883530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.894655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.902833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e353-b16e-40e2-9792-e38685405f2f service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.904629 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 881/1778] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:17.939751 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 898/1779] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:18.132678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.135215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.148083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:18.283497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9314-bb45-4f6a-97fe-03b6c643554d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.283497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9314-bb45-4f6a-97fe-03b6c643554d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.289869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9314-bb45-4f6a-97fe-03b6c643554d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.289869 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 899/1780] 10.222.0.36 () {54 vars in 912 bytes} [Sun Aug 7 01:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:18.292353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e034-71c9-4e70-9a55-44f551c84622 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.292595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e034-71c9-4e70-9a55-44f551c84622 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.292879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e034-71c9-4e70-9a55-44f551c84622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.362490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a587e034-71c9-4e70-9a55-44f551c84622 None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:18.362490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a587e034-71c9-4e70-9a55-44f551c84622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.376604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de590eed-d547-4864-ba96-71004a23f132 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.389491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.391837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.392936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.394014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] PATH_INFO: `/v3/projects/d1ef15c3801e453b8a0eadf0d4679cdd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.396761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ef15c3801e453b8a0eadf0d4679cdd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.402271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:18.492808 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 900/1781] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 07 01:17:18.498055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.501545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.501958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.526976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:18.528443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.571315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ef15c3801e453b8a0eadf0d4679cdd', 'request_id': 'req-787e2933-892f-41d2-b441-ea8215437be6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.575621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ef15c3801e453b8a0eadf0d4679cdd', 'request_id': 'req-787e2933-892f-41d2-b441-ea8215437be6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.617135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ef15c3801e453b8a0eadf0d4679cdd', 'request_id': 'req-787e2933-892f-41d2-b441-ea8215437be6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.719026 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 901/1782] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:18.719972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.741952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83040e-c410-46e3-b0d3-d40a2bf959c6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.743116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] The token cache is being invalidate because project d1ef15c3801e453b8a0eadf0d4679cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:18.743971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.746316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.757063 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 882/1783] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:18 2022] DELETE /identity/v3/projects/d1ef15c3801e453b8a0eadf0d4679cdd => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:18.763843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.768212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.896923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.898875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.899995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.900877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.903644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.914987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.917430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:18.927209 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 902/1784] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:18.929345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.930422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.956164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2933-892f-41d2-b441-ea8215437be6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.965319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.966019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.966306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.966579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] PATH_INFO: `/v3/users/ce640c21e184478e90b10dd4a093cbc7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.969212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce640c21e184478e90b10dd4a093cbc7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.971911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.048145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6776f93-6518-4241-857d-6bf37b5168e0 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.054088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.054952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.055114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.055399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.057317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.183287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.185358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb2a7-fcf8-4313-a649-9ce328049d16 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.195996 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 903/1785] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:19.332226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce640c21e184478e90b10dd4a093cbc7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.396140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce640c21e184478e90b10dd4a093cbc7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.526376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce640c21e184478e90b10dd4a093cbc7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.527216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce640c21e184478e90b10dd4a093cbc7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.554045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce640c21e184478e90b10dd4a093cbc7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.592869 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 883/1786] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:18 2022] DELETE /identity/v3/users/ce640c21e184478e90b10dd4a093cbc7 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:19.795460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.796438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.797478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.841159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:19.842900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.950970 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 904/1787] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 7 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:20.010843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:20.014534 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:20.062378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc0c8-cc84-4ce8-ab40-feac8a2a8331 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.070496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:20.071369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.071643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.071919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.141877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:20.145096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6f9ed-5b14-4b23-ba86-405533e3f28a service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:20.173594 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 884/1788] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:20.228276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:20.520017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:20.903664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:20.905987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:21.150186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4a4a3-fdea-4105-a269-41818fe40b1e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:21.157557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:21.158564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.159128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.159617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] PATH_INFO: `/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.162660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837cd0f5dc374c6f8738963d0b27e1d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:21.169623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:21.406057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837cd0f5dc374c6f8738963d0b27e1d9', 'request_id': 'req-b46cd544-a468-4ab4-bd82-20cb9e589ce9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:21.430018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837cd0f5dc374c6f8738963d0b27e1d9', 'request_id': 'req-b46cd544-a468-4ab4-bd82-20cb9e589ce9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:21.440635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837cd0f5dc374c6f8738963d0b27e1d9', 'request_id': 'req-b46cd544-a468-4ab4-bd82-20cb9e589ce9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:21.571918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] The token cache is being invalidate because project 837cd0f5dc374c6f8738963d0b27e1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:21.571918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:21.571918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b46cd544-a468-4ab4-bd82-20cb9e589ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:21.571918 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 905/1789] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:20 2022] DELETE /identity/v3/projects/837cd0f5dc374c6f8738963d0b27e1d9 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:21.577447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.578354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.578794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.678303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:21.678303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:21.879995 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 885/1790] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:21.887009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.887654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.887956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.919831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:21.922096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:21.951166 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 906/1791] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:21.955551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:21.967385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20529d38-09dd-46ad-89e3-d9fcf054791e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:21.988017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:21.989479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.990365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.990857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.991820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:21.992701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:21.995772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.017937 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 886/1792] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:22.020985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.033321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98bff-e4ad-43c7-9fea-49f202d70192 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.047280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.048217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.048527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.048915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.049655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.051955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972a992-f00c-48ef-add8-4ffd99873485 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.204390 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 907/1793] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:22 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:22.205480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.233514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954d4d-3d09-4126-83f3-d6a3450b33b6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.331208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.331889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.332393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.332798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.333992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.336904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.384371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269cb5-f6ff-4ec1-8189-381e95ed1369 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.386915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269cb5-f6ff-4ec1-8189-381e95ed1369 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.387175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269cb5-f6ff-4ec1-8189-381e95ed1369 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.389216 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 908/1794] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:17:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:22.445666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:22.457111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.458192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.458372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.483472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:22.485150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:22.518355 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 887/1795] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:22 2022] POST /identity/v3/users => generated 285 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:22.521988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.532580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c95ff-b9a6-40f4-a715-78d5f398445d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.538005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.538668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.538959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.539459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.540318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.542047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.554768 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 888/1796] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:22.558447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.569988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795f07-95eb-44ee-8a44-c20f3b2a1d41 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.579293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.581167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.581816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.582451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.584011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.586210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.599254 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 889/1797] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:22.603539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.605960 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 909/1798] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:22.618589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.620111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:22.624587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007607d0-84ef-4b97-8303-0f746326cff9 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.629981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.630840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.631122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.631421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] PATH_INFO: `/v3/projects/0e0d6b8b56d24d0fbfa41202856f53ba/users/b1ca5187d19a4795ba61692a1a98a597/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.637561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccff92-4921-4695-8ed4-dce074f82e20 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.644127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.646641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.646641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.646641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.652056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0d6b8b56d24d0fbfa41202856f53ba, user_id=b1ca5187d19a4795ba61692a1a98a597, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.655231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.674881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.677345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7f8d5-3778-49ca-b898-f5f54b0ddcfe service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.689380 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 910/1799] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:22.872321 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 890/1800] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:22 2022] PUT /identity/v3/projects/0e0d6b8b56d24d0fbfa41202856f53ba/users/b1ca5187d19a4795ba61692a1a98a597/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:22.873929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.874460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.874983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.931010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] MFA Rules not processed for user `b1ca5187d19a4795ba61692a1a98a597`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:22.933607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:23.026316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:23.051876 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 911/1801] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:23.057312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.188194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc6a05-f149-47fa-939f-3343c8497ece admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.188194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.188194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.188194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.188638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.188638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.188638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.458938 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 891/1802] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:23 2022] POST /identity/v3/projects => generated 369 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:23.462900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.475300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ee6f-c5a9-453d-aad6-eb70444326bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.545533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.546180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.546475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.546870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.547510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.549469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.690339 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 912/1803] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:23 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:23.691685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.703240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970dc1c-3a65-4418-ba1e-e0ff5f99c573 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.708297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.708898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.709188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.709468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.710155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.711830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.724360 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 892/1804] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:23.729353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.741428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca3b-7412-4473-8615-3b58ac5dddbb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.746478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.747274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.747690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.748065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] PATH_INFO: `/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac/users/af6b32250c464fa0bbbf631bb1a97bee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.765431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fedbe5a091e40c38e2f0ea9c8e1e3ac, user_id=af6b32250c464fa0bbbf631bb1a97bee, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.768154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.788300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:23.854488 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 913/1805] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:23 2022] PUT /identity/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac/users/af6b32250c464fa0bbbf631bb1a97bee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:23.858414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.872040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4900625-8fb3-4baf-9a1f-0c7580729866 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.935319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.936328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.936787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.937281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.938136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.940062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.954413 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 893/1806] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:23.955745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:23.967425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61dc37-e053-449d-90a4-084966970065 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:23.972418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:23.973760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:23.974222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:23.974514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] PATH_INFO: `/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac/users/af6b32250c464fa0bbbf631bb1a97bee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:23.981187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fedbe5a091e40c38e2f0ea9c8e1e3ac, user_id=af6b32250c464fa0bbbf631bb1a97bee, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:23.983929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145a34-5343-48bc-853e-e2210822882d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:23.998603 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 914/1807] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:23 2022] PUT /identity/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac/users/af6b32250c464fa0bbbf631bb1a97bee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:24.009164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.009736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.010071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.015853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.015973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.024963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ba6c-cd75-423c-b5a8-73aa8898e2c2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.077264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] MFA Rules not processed for user `af6b32250c464fa0bbbf631bb1a97bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:24.080464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.155646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.156285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.156748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.156862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] PATH_INFO: `/v3/users/99b15f39b3344f67a1cf776698ad4f45` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.158198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b15f39b3344f67a1cf776698ad4f45)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:24.160145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:24.191233 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 915/1808] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:24.204065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.205732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.311463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4a754-24c8-4af4-a53b-85bc85d1c402 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.315356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.315969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.316253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.316530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.326592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:24.328322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:24.357637 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 916/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:24.398194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b15f39b3344f67a1cf776698ad4f45'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.406166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b15f39b3344f67a1cf776698ad4f45'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.516736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b15f39b3344f67a1cf776698ad4f45'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.517367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b15f39b3344f67a1cf776698ad4f45'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.532942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d212f7ce-5b5a-40f6-80e7-b6bd424d8ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b15f39b3344f67a1cf776698ad4f45'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.539280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 894/1810] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:24 2022] DELETE /identity/v3/users/99b15f39b3344f67a1cf776698ad4f45 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:24.539447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.540710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.543396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.543717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.543996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.551639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c12e74-0ebe-4dd9-893e-5fa0672e688f service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.562279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:24.563470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.605919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.606701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.607122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.607444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.609514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.634220 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 895/1811] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:24.644206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.652504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.686850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:24.686850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:24.709789 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 917/1812] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:24.730765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2435d7-ced7-4ac1-ac06-153cef5799c7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.739887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.739887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.739887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.739887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.753916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:24.755771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:24.765677 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 896/1813] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:25.239522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.241075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:25.265423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083552b-0dcc-4315-84eb-2bc1fb861959 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.278146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.278772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.279180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.279527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.281605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:25.367879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.370342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:25.394404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.397172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.407638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe3fb-73a4-407d-9239-987d0041fc62 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.437746 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 918/1814] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:25.438312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.440340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.440958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.442779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] PATH_INFO: `/v3/projects/59fd9ef3c9b7439486c69e6d5acf262a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.445105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fd9ef3c9b7439486c69e6d5acf262a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.450606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.465755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:25.620897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fd9ef3c9b7439486c69e6d5acf262a', 'request_id': 'req-16eda2ce-e65f-4969-b7ec-3820c72441cd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:25.639741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fd9ef3c9b7439486c69e6d5acf262a', 'request_id': 'req-16eda2ce-e65f-4969-b7ec-3820c72441cd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:25.647650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fd9ef3c9b7439486c69e6d5acf262a', 'request_id': 'req-16eda2ce-e65f-4969-b7ec-3820c72441cd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:25.854011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] The token cache is being invalidate because project 59fd9ef3c9b7439486c69e6d5acf262a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:25.854836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:25.856410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:25.860943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:25.864009 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 897/1815] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:25 2022] DELETE /identity/v3/projects/59fd9ef3c9b7439486c69e6d5acf262a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:25.868110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.882853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8508e44-21f4-4395-9e4c-7a8f8d219a71 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.959137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.959954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.960309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.960658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] PATH_INFO: `/v3/users/95a6540f6f21490fa5c98c88743d7166` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.961948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a6540f6f21490fa5c98c88743d7166)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.964008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:26.185069 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a6540f6f21490fa5c98c88743d7166'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.271484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a6540f6f21490fa5c98c88743d7166'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.284581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a6540f6f21490fa5c98c88743d7166'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.284788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:26.286113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a6540f6f21490fa5c98c88743d7166'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.286838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:26.300550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-341ed869-e4c3-4d84-8ee5-76ec4619d1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a6540f6f21490fa5c98c88743d7166'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.305443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eda2ce-e65f-4969-b7ec-3820c72441cd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:26.308090 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 919/1816] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:25 2022] DELETE /identity/v3/users/95a6540f6f21490fa5c98c88743d7166 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:26.310299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:26.318330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:26.319266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:26.319816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] PATH_INFO: `/v3/users/3683cdabdec841c88d0b42cf3c838eb2` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:26.321458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3683cdabdec841c88d0b42cf3c838eb2)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:26.323647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:26.525203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:26.842269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3683cdabdec841c88d0b42cf3c838eb2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:26.862121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3683cdabdec841c88d0b42cf3c838eb2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.019453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3683cdabdec841c88d0b42cf3c838eb2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.020415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3683cdabdec841c88d0b42cf3c838eb2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.032813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3683cdabdec841c88d0b42cf3c838eb2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.041676 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 898/1817] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:26 2022] DELETE /identity/v3/users/3683cdabdec841c88d0b42cf3c838eb2 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:27.043894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.044178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.044450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.063202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:27.064402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:27.116476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:27.118480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:27.126848 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 920/1818] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:27.134806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09703e-1a5e-415a-b33e-837eb9002ee0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:27.137332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:27.139501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:27.140755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:27.141726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.141997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.142276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] PATH_INFO: `/v3/projects/cdcf47626595483285db4ccd2626cbe8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.143881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcf47626595483285db4ccd2626cbe8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:27.147645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:27.219405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6cd71-e7a3-4da3-9cbd-64c0def51595 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:27.225570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:27.226282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.228631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.228631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.236177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:27.237686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f94279-8c3e-40bf-961c-c7e4f63fd682 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:27.250050 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 921/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:27.341812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcf47626595483285db4ccd2626cbe8', 'request_id': 'req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.350354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcf47626595483285db4ccd2626cbe8', 'request_id': 'req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.357761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcf47626595483285db4ccd2626cbe8', 'request_id': 'req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.591216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] The token cache is being invalidate because project cdcf47626595483285db4ccd2626cbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:27.591216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.591216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f9d9bd53-3ad9-4bf6-a6bc-01c8fdc9ec7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:27.592922 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 899/1820] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:27 2022] DELETE /identity/v3/projects/cdcf47626595483285db4ccd2626cbe8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:27.600461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.601071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.601071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.623879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:27.625643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:27.697963 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 922/1821] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:27.706377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.706685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.706950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.740627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:27.742015 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:27.766299 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 900/1822] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:27.767358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:27.778241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4279f-ddd9-49c4-a851-f98202a3b56a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:27.784291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:27.785793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.786357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.787047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.788116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:27.788618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:27.790685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:27.803997 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 923/1823] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:27.809104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:27.824322 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c69b9-e413-4f21-bdea-097f6d597a25 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:27.830451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:27.831177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:27.831855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:27.832769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:27.835262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:27.840638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.018687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.021145 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:28.022545 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 901/1824] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:27 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:28.026543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.041133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:28.045455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4f6f-1db7-40a0-bf22-0bf8aa34f0c9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.122443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8bc0f-3964-4b24-855b-0e2fba6cbea2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.131159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.132608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.133122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.133606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.134511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.144142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.144142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.144409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.145038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.145038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] PATH_INFO: `/v3/projects/3ee1fe6864314b15aaf4d31ea2ed17c0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.145038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1fe6864314b15aaf4d31ea2ed17c0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.145038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.279146 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 902/1825] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:28.286173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.295892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771451b3-d386-4f06-89f5-236f86c059ac admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.301617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.302289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.303065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.303717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.305780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:28.316993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.316993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.319959 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 903/1826] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:28.323220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1fe6864314b15aaf4d31ea2ed17c0', 'request_id': 'req-a4ea4965-559c-4944-8718-eee00ae5a70a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:28.323785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.330318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1fe6864314b15aaf4d31ea2ed17c0', 'request_id': 'req-a4ea4965-559c-4944-8718-eee00ae5a70a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:28.336599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f93a-ea39-42b7-b9f4-c8b6dea4f7f0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.348700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1fe6864314b15aaf4d31ea2ed17c0', 'request_id': 'req-a4ea4965-559c-4944-8718-eee00ae5a70a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:28.396145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.397954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.397954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.397954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.398226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.399757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.409403 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 904/1827] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:28.413464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.422850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac82d-9b6e-441b-9982-1e2176b82547 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.428750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.429525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.429814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.430172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] PATH_INFO: `/v3/projects/39eba11391db41a297019a17b7b79ab0/users/9d815ee1db0e4bab9d83cfe9f9c5b22d/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.438853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] The token cache is being invalidate because project 3ee1fe6864314b15aaf4d31ea2ed17c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:28.438853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:28.439731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a4ea4965-559c-4944-8718-eee00ae5a70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:28.442873 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 924/1828] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:28 2022] DELETE /identity/v3/projects/3ee1fe6864314b15aaf4d31ea2ed17c0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:28.451389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39eba11391db41a297019a17b7b79ab0, user_id=9d815ee1db0e4bab9d83cfe9f9c5b22d, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.451868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda6bf-1ead-460e-a058-2dbcfbff9bd0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.452126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda6bf-1ead-460e-a058-2dbcfbff9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.452403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda6bf-1ead-460e-a058-2dbcfbff9bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.454936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf2f5-aca0-465a-bdb2-653cbfb0ab26 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.474564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d3cda6bf-1ead-460e-a058-2dbcfbff9bd0 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:28.475802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d3cda6bf-1ead-460e-a058-2dbcfbff9bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:28.484083 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 925/1829] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:28.492173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.492878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.492878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.513740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:28.513872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:28.522379 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 926/1830] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:28.526522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.535406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d075600-4c55-4d4a-a561-2fd45512af40 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.540123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.542275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.542275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.542275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.542275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:28.542275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.543739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.558945 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 927/1831] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:28.559774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.580808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8b06-11e1-4e83-8ecc-c65e9e520b6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.580896 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 905/1832] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:28 2022] PUT /identity/v3/projects/39eba11391db41a297019a17b7b79ab0/users/9d815ee1db0e4bab9d83cfe9f9c5b22d/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:28.591511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.591862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.592600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.624512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] MFA Rules not processed for user `9d815ee1db0e4bab9d83cfe9f9c5b22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:28.625726 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:28.630185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.631405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.631715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.632013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.632877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.635033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.705905 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 906/1833] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:28.714995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.716414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:28.757871 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 928/1834] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:28.760172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.788406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7d60-be9c-4186-a46a-a240a70b50b3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.828265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06555614-88cf-4b61-b0df-b2fc15a3c47a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.835257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.836181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.836468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.836747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.837381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.839387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.840249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.840999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.841285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.841565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.904844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.906352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.915867 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 907/1835] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:28.952230 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 929/1836] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:28 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:28.955708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:28.971470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55166-9c46-4b6f-a5ec-5549baf84f69 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:28.978217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:28.980453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:28.980453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:28.980453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:28.980453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:28.983118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:28.997790 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 908/1837] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:28.999140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.012809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84274b09-4a91-4115-9d96-d3a6d34200e0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.020864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.021618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.022032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.022408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.023167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.024871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ca91-3b8b-48cf-bbf0-defea5599bdb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:29.036688 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 930/1838] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:29.041303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.052471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b33075-e55b-4702-9b6f-2d19559da1b7 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.057053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.057711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.058131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.058413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] PATH_INFO: `/v3/projects/d4a83737e2644b02a083a9e724fd9563/users/c86cb177ce9642f38e77cbb7eba9e15d/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.074560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a83737e2644b02a083a9e724fd9563, user_id=c86cb177ce9642f38e77cbb7eba9e15d, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.077480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:29.176820 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 909/1839] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:29 2022] PUT /identity/v3/projects/d4a83737e2644b02a083a9e724fd9563/users/c86cb177ce9642f38e77cbb7eba9e15d/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:29.187180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.187477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.187761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.218310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] MFA Rules not processed for user `c86cb177ce9642f38e77cbb7eba9e15d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:29.219458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:29.296153 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 931/1840] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:29.301703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.374032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ee0b-ccbb-420e-835b-9307b119fdab admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.380389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.381263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.381708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.382193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.382973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.385812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:29.544414 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 910/1841] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:29 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:29.548407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.559905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f8d27-1b5d-45f2-8b3f-f2af0f010fa2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.586296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:29.628996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.629924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.630265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.630835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.631131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.633222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:29.745335 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 932/1842] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:29 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:29.749417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.760191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41419e9d-3d53-4767-82ed-f5c7c2d4a00f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.764716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.765321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.765584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.765876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.766647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.768224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:29.779211 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 911/1843] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:29.797865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:29.808314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64508-df8d-4852-aa25-39578ea96178 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:29.812986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:29.813707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:29.814017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:29.814291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] PATH_INFO: `/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca/users/a4adb3c007b6406f930ec56042ce7264/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:29.835793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a87a8aa3214d61b4c07456b5a229ca, user_id=a4adb3c007b6406f930ec56042ce7264, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:29.838679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:30.044983 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 933/1844] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:29 2022] PUT /identity/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca/users/a4adb3c007b6406f930ec56042ce7264/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:30.050298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:30.059919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35ecb-4265-494c-855a-42c4d823a787 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:30.123665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:30.124269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:30.124554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:30.124839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:30.125475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:30.127127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc789b07-d2ba-4443-9072-8cc105e6c293 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:30.137957 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 912/1845] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:30.142652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:30.153048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc48e8-5ca6-4c49-b283-6e2a2d2e1c93 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:30.157520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:30.158203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:30.158482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:30.158752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] PATH_INFO: `/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca/users/a4adb3c007b6406f930ec56042ce7264/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:30.160837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a87a8aa3214d61b4c07456b5a229ca, user_id=a4adb3c007b6406f930ec56042ce7264, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:30.163531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:30.173883 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 934/1846] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:30 2022] PUT /identity/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca/users/a4adb3c007b6406f930ec56042ce7264/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:30.192147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:30.192147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:30.192147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:30.220275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] MFA Rules not processed for user `a4adb3c007b6406f930ec56042ce7264`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:30.225785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:30.292321 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 913/1847] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:30.334444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:30.336636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:30.394202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea007-d9db-416e-a09b-1cf0a10c49e4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:30.399713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:30.400326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:30.400612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:30.400887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:30.411784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:30.415068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:30.424292 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 935/1848] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:30.919097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:31.421093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:31.430473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10ef9a-0f5a-4181-bac2-7008db273f62 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:31.433952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:31.445786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:31.445786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:31.445786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:31.493345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:31.494862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa81ab-95b4-4ead-a397-ffad61838940 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:31.505186 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 914/1849] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:31.920668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:31.922271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:31.985303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476474-a8c0-4f12-9eb9-c0d1f1c893f3 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:31.990556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:31.991105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:31.991385 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:31.991658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] PATH_INFO: `/v3/users/b1ca5187d19a4795ba61692a1a98a597` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:31.992768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ca5187d19a4795ba61692a1a98a597)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:31.994782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:32.256927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ca5187d19a4795ba61692a1a98a597'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:32.381204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ca5187d19a4795ba61692a1a98a597'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:32.397622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ca5187d19a4795ba61692a1a98a597'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:32.397622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ca5187d19a4795ba61692a1a98a597'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:32.402887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ca5187d19a4795ba61692a1a98a597'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:32.413213 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 936/1850] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:31 2022] DELETE /identity/v3/users/b1ca5187d19a4795ba61692a1a98a597 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:32.415852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:32.416144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:32.416426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:32.437068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:32.438300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:32.497930 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 915/1851] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:32.508463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:32.509816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:32.525089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:32.572595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60b37b-3a78-427a-8a13-e350a872cd9a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:32.576980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:32.577675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:32.578048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:32.578385 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:32.589440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:32.590960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:32.601998 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 937/1852] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:33.137212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:33.138662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:33.152796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e0a80-47cb-4259-a408-7e84bbff48ea None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:33.156148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:33.156867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:33.157156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:33.157433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] PATH_INFO: `/v3/projects/0e0d6b8b56d24d0fbfa41202856f53ba` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:33.158596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0d6b8b56d24d0fbfa41202856f53ba)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:33.161247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:33.300188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0d6b8b56d24d0fbfa41202856f53ba', 'request_id': 'req-d3deb8c2-5407-4600-95c7-fbd03808a02e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:33.305686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0d6b8b56d24d0fbfa41202856f53ba', 'request_id': 'req-d3deb8c2-5407-4600-95c7-fbd03808a02e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:33.312414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0d6b8b56d24d0fbfa41202856f53ba', 'request_id': 'req-d3deb8c2-5407-4600-95c7-fbd03808a02e'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:33.432953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] The token cache is being invalidate because project 0e0d6b8b56d24d0fbfa41202856f53ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:33.438716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:33.438716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:33.438716 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 916/1853] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:33 2022] DELETE /identity/v3/projects/0e0d6b8b56d24d0fbfa41202856f53ba => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:33.441855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:33.451904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6abf-5bc9-4fb7-b3f9-e59c664f3f34 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:33.513042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:33.516972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:33.516972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:33.516972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] PATH_INFO: `/v3/users/af6b32250c464fa0bbbf631bb1a97bee` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:33.516972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6b32250c464fa0bbbf631bb1a97bee)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:33.519108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:34.144842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6b32250c464fa0bbbf631bb1a97bee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:34.232941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6b32250c464fa0bbbf631bb1a97bee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:34.242969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6b32250c464fa0bbbf631bb1a97bee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:34.243252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6b32250c464fa0bbbf631bb1a97bee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:34.255837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5a258ddf-2057-463e-be2e-ad454d6fc28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6b32250c464fa0bbbf631bb1a97bee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:34.262410 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 938/1854] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:33 2022] DELETE /identity/v3/users/af6b32250c464fa0bbbf631bb1a97bee => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:34.960206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:34.966189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:34.989384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb8c2-5407-4600-95c7-fbd03808a02e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.046994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.047624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.047922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.048183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] PATH_INFO: `/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.049297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fedbe5a091e40c38e2f0ea9c8e1e3ac)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.051912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.236319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fedbe5a091e40c38e2f0ea9c8e1e3ac', 'request_id': 'req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.243592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fedbe5a091e40c38e2f0ea9c8e1e3ac', 'request_id': 'req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.261078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fedbe5a091e40c38e2f0ea9c8e1e3ac', 'request_id': 'req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.404020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] The token cache is being invalidate because project 4fedbe5a091e40c38e2f0ea9c8e1e3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:35.404862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.405456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-09ecaca4-dc3c-4c12-a6dc-4ca90a182450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.406471 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 917/1855] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:34 2022] DELETE /identity/v3/projects/4fedbe5a091e40c38e2f0ea9c8e1e3ac => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:35.412046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.412546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.413022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.432986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:35.439454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.499739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:35.499850 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 939/1856] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:35.507655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.507938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.508356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.527927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:35.529116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.537777 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 918/1857] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:35.541964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.551624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54955bf-d1c6-412d-8e0d-fb2f4edff15a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.556509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.557132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.557412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.557683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.558455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:35.564162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.564162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.572302 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 940/1858] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:35.579746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.590803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e37972-a08c-447a-af9d-1a889b604521 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.595927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.596607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.596829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.597282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.598613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.600761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.606954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.608594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.622752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be4fc-59a8-449f-b946-974d3799d80f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.627658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.628456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.628849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.629310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] PATH_INFO: `/v3/users/9d815ee1db0e4bab9d83cfe9f9c5b22d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.630630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d815ee1db0e4bab9d83cfe9f9c5b22d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.632667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.780568 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 919/1859] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:35 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:35.785142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.847957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eca2a-009b-4ba3-b3cf-842ca9cc7c15 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.852846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.853456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.853741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.854049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.854743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.856804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.897140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d815ee1db0e4bab9d83cfe9f9c5b22d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:35.993616 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 920/1860] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:35 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:35.997636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.998355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d815ee1db0e4bab9d83cfe9f9c5b22d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:36.006534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d815ee1db0e4bab9d83cfe9f9c5b22d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:36.006534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d815ee1db0e4bab9d83cfe9f9c5b22d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:36.007481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5346-dd51-4bb9-9ef3-84715a80e41f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.012573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.013175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.013461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.013737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.014548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.016162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42ce22-3e1e-4364-a58a-1b3ab8872a5e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.020931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d815ee1db0e4bab9d83cfe9f9c5b22d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:36.030825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 921/1861] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:36.031463 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 941/1862] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:35 2022] DELETE /identity/v3/users/9d815ee1db0e4bab9d83cfe9f9c5b22d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:36.038471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:36.039368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.039368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.039368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.039959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:36.060176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:36.061377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:36.108304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac76a-1fc4-4715-9db1-090302acba46 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.114228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.114936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.115171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.115472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.116186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.118275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.121043 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 922/1863] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:36.130349 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 942/1864] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:36.135723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:36.140302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:36.142399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:36.145801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266843c-7822-4821-a6ac-1affeba3f5ab None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.159019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.160368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.161347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.161859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] PATH_INFO: `/v3/projects/d4abe1e02bec42f19217b31d336df1ac/users/29cf9794f4104f639f0b7e80914ef8f3/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.178871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4abe1e02bec42f19217b31d336df1ac, user_id=29cf9794f4104f639f0b7e80914ef8f3, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.182439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.208040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b5cf-b254-4c42-98e9-42f756667341 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.208563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.209469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.209827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.210059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.220812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.222320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b634-1bd6-4747-9441-f31b9736979c service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.232458 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 943/1865] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:36.419388 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 923/1866] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:36 2022] PUT /identity/v3/projects/d4abe1e02bec42f19217b31d336df1ac/users/29cf9794f4104f639f0b7e80914ef8f3/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:36.426912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.434505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.434505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.458887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] MFA Rules not processed for user `29cf9794f4104f639f0b7e80914ef8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:36.460582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:36.479807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:36.482310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:36.552498 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 944/1867] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:36.563511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:36.678733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb559b9-51c2-4a9e-997f-d26efacab2c7 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.705141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.706458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.707591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.707948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] PATH_INFO: `/v3/users/c86cb177ce9642f38e77cbb7eba9e15d` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.717167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86cb177ce9642f38e77cbb7eba9e15d)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.719705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.722637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59faa56-7a88-447c-8a2e-193171c3f9fe None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:36.739395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:36.739682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:36.739967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:36.740242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:36.740876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:36.742828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.942901 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 945/1868] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:36 2022] POST /identity/v3/projects => generated 387 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:36.946818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.000113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86cb177ce9642f38e77cbb7eba9e15d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.009044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86cb177ce9642f38e77cbb7eba9e15d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.018857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12df2b-3ca3-4467-b3ae-5903d604bb56 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.023874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.024515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.024798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.025075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.025791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.027737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.138938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86cb177ce9642f38e77cbb7eba9e15d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.139731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86cb177ce9642f38e77cbb7eba9e15d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.145249 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 946/1869] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:36 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:37.146307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.149545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.153275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86cb177ce9642f38e77cbb7eba9e15d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.159400 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 924/1870] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:36 2022] DELETE /identity/v3/users/c86cb177ce9642f38e77cbb7eba9e15d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:37.160381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.161241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b9e63-2e47-44d3-8145-1b1ad597d1ac admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.161716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.217587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.218247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.218528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.218804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] PATH_INFO: `/v3/projects/39eba11391db41a297019a17b7b79ab0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.219933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39eba11391db41a297019a17b7b79ab0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.221897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.227141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e565e-a768-42f3-8eeb-14daf3ef40a1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.233619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.237176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.237176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.237176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.237176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.237176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb0db0-7aa8-407d-a407-3689aca48788 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.251248 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 925/1871] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:37.251248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.251248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.251248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.273926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:37.273926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.280834 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 926/1872] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:37.281595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.291287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4d590-9f6f-4414-86cb-5e549876cc81 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.296197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.296884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.297197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.297504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] PATH_INFO: `/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf/users/eea4b0ab834949b988bd9daa7a3515d5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.315667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e0acde82e74a5bbc1fd5ac64d01dcf, user_id=eea4b0ab834949b988bd9daa7a3515d5, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.319111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.608155 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 927/1873] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:37 2022] PUT /identity/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf/users/eea4b0ab834949b988bd9daa7a3515d5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:37.610247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.611362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.616320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39eba11391db41a297019a17b7b79ab0', 'request_id': 'req-6c355384-dd5b-4798-8720-c11fd28f3523'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.621852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39eba11391db41a297019a17b7b79ab0', 'request_id': 'req-6c355384-dd5b-4798-8720-c11fd28f3523'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.628198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39eba11391db41a297019a17b7b79ab0', 'request_id': 'req-6c355384-dd5b-4798-8720-c11fd28f3523'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.667448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:37.668578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ea11-792c-4607-ba4c-49cf85f2eb1a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.719270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] The token cache is being invalidate because project 39eba11391db41a297019a17b7b79ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:37.719270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.719270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:37.719567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.719663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.719954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.720134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.724006 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 947/1874] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:37 2022] DELETE /identity/v3/projects/39eba11391db41a297019a17b7b79ab0 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:37.724542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.725064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.726834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.796288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.798046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.798789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355384-dd5b-4798-8720-c11fd28f3523 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.804297 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.805073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.805530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.805813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.811001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.811001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314103-f201-4572-917e-a82212bd7e15 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.820975 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 948/1875] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:37.821620 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 928/1876] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:37.823425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f07ee-919b-438c-b855-183f3f653ed0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.823884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f07ee-919b-438c-b855-183f3f653ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.824319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f07ee-919b-438c-b855-183f3f653ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.827384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:37.836895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce173b2d-0846-42fc-92c3-7a27816fd24e service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:37.841913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:37.842580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.842859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.843139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] PATH_INFO: `/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf/users/eea4b0ab834949b988bd9daa7a3515d5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.845345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e0acde82e74a5bbc1fd5ac64d01dcf, user_id=eea4b0ab834949b988bd9daa7a3515d5, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:37.849174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191eb64-811f-45b7-b50e-d5478fd052f9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:37.866787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-003f07ee-919b-438c-b855-183f3f653ed0 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:37.866787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-003f07ee-919b-438c-b855-183f3f653ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:37.867032 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 929/1877] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:37 2022] PUT /identity/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf/users/eea4b0ab834949b988bd9daa7a3515d5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:37.875169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:37.875461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:37.876045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:37.926230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] MFA Rules not processed for user `eea4b0ab834949b988bd9daa7a3515d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:37.929334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:38.019157 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 949/1878] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:38.033580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.033580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.033580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.050264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:38.050825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 930/1879] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:38.052480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:38.062483 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 950/1880] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:38.066835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.067960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.068277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:38.079924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b0f6-c772-4625-b186-92c788bfe780 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.086682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.087730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.088089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.088428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.089216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:38.089600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.091493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.105152 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 951/1881] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:38.109102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.130814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437580-4f8a-47ca-951c-3c06a92005b0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.136754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.137185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.137545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.138039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.139008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.141918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.161101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c8a48-8231-4eb1-b2c9-37113c0736ed None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.165265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.170610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.170610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.170610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.177855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.179626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.191190 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 931/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:38.265012 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 952/1883] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:38 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:38.270037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.283224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfd34-943a-49a7-8d94-900b119657f1 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.560396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.560396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.560396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.560396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.561452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.561452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.726437 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 932/1884] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:38 2022] POST /identity/v3/users => generated 288 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:38.730580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.735617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.736867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:38.766343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c131-087f-48e6-847f-7583a8677051 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.776485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdeb2f-f2aa-4326-92a5-65426cb031ac admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.787237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.787881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.788167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.788446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.789123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.792365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.794100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.794229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.794229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.794229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] PATH_INFO: `/v3/projects/d4a83737e2644b02a083a9e724fd9563` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.795597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a83737e2644b02a083a9e724fd9563)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.797615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.833760 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 953/1885] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:38.837539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.849586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a67d06-27e3-4f60-bdd3-a90136940502 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.875139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.875760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.876042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.876317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.876963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.878633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:38.890085 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 954/1886] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:38.893794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:38.904166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef42d7-a138-4e5f-a83f-693a22e7f6e5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:38.909919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:38.910549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:38.910850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:38.912615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] PATH_INFO: `/v3/projects/58a87d95208a488dac6a1559462c6445/users/264ff114924043cb81e271513628e0dd/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:38.928982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a87d95208a488dac6a1559462c6445, user_id=264ff114924043cb81e271513628e0dd, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:38.932611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21278a4f-d8fc-4882-a412-5b730dedf6e4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:39.070884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a83737e2644b02a083a9e724fd9563', 'request_id': 'req-dd9becd6-98a9-48c6-ba01-1090291ac96c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.072809 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 955/1887] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:38 2022] PUT /identity/v3/projects/58a87d95208a488dac6a1559462c6445/users/264ff114924043cb81e271513628e0dd/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:39.074498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:39.074783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:39.075058 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:39.088766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a83737e2644b02a083a9e724fd9563', 'request_id': 'req-dd9becd6-98a9-48c6-ba01-1090291ac96c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.098585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a83737e2644b02a083a9e724fd9563', 'request_id': 'req-dd9becd6-98a9-48c6-ba01-1090291ac96c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.109407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] MFA Rules not processed for user `264ff114924043cb81e271513628e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:39.111799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:39.176472 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 956/1888] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:39.187139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:39.191835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:39.192892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] The token cache is being invalidate because project d4a83737e2644b02a083a9e724fd9563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:39.193196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.193878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.195403 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 933/1889] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:38 2022] DELETE /identity/v3/projects/d4a83737e2644b02a083a9e724fd9563 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:39.200098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:39.201854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:39.307766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc667b3-0e53-498b-beec-7e27cf2f58a3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:39.323940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:39.324764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:39.325053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:39.325331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:39.330675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:39.358385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9becd6-98a9-48c6-ba01-1090291ac96c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:39.366081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:39.367243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:39.367623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:39.368261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:39.368732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:39.369164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] PATH_INFO: `/v3/users/a4adb3c007b6406f930ec56042ce7264` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:39.370601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4adb3c007b6406f930ec56042ce7264)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:39.373248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:39.383192 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 957/1890] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:39.650059 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4adb3c007b6406f930ec56042ce7264'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.656573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4adb3c007b6406f930ec56042ce7264'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.739556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:39.763619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4adb3c007b6406f930ec56042ce7264'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.764311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4adb3c007b6406f930ec56042ce7264'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.777844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4adb3c007b6406f930ec56042ce7264'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:39.783812 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 934/1891] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:39 2022] DELETE /identity/v3/users/a4adb3c007b6406f930ec56042ce7264 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:39.879333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:40.704807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:40.716018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c6ba5-a1e6-4309-87c9-29868fa9e864 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:40.734573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:40.735960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:40.806126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:40.806896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:40.807183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:40.807459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] PATH_INFO: `/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:40.808589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a87a8aa3214d61b4c07456b5a229ca)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:40.811001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:40.817020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614412f-5546-481e-a788-1ff2e61d181d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:40.822792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:40.823506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:40.823879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:40.824228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] PATH_INFO: `/v3/users/29cf9794f4104f639f0b7e80914ef8f3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:40.825871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cf9794f4104f639f0b7e80914ef8f3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:40.828226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:40.970197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a87a8aa3214d61b4c07456b5a229ca', 'request_id': 'req-d944d519-a48d-418d-ba84-332ca4f208da'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:40.977301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a87a8aa3214d61b4c07456b5a229ca', 'request_id': 'req-d944d519-a48d-418d-ba84-332ca4f208da'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:40.983898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a87a8aa3214d61b4c07456b5a229ca', 'request_id': 'req-d944d519-a48d-418d-ba84-332ca4f208da'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.004969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:41.118589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] The token cache is being invalidate because project d8a87a8aa3214d61b4c07456b5a229ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:41.118910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.119677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d944d519-a48d-418d-ba84-332ca4f208da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.121274 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 958/1892] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:40 2022] DELETE /identity/v3/projects/d8a87a8aa3214d61b4c07456b5a229ca => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:41.126624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a53d-7d36-41db-8c37-d056975295b2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.126936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a53d-7d36-41db-8c37-d056975295b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.127225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a53d-7d36-41db-8c37-d056975295b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.128630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cf9794f4104f639f0b7e80914ef8f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.135953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cf9794f4104f639f0b7e80914ef8f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.147358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9b21a53d-7d36-41db-8c37-d056975295b2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:41.152150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9b21a53d-7d36-41db-8c37-d056975295b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.210829 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 959/1893] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:41.218752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.219117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.219561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.255806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:41.257136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.281747 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 960/1894] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:41.287160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.317523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23592928-95ba-484f-b710-78a05bc6dae7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.317523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.317523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.317523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.322351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.324257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:41.324772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.327099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.344568 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 961/1895] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:41.345669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.358451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492c8b-bcf4-4dd2-bcab-20cbc06b3052 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.359106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cf9794f4104f639f0b7e80914ef8f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.359837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cf9794f4104f639f0b7e80914ef8f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.372594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.373381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.374648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.375198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.377536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.380611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.397479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-edfe832b-30c1-4883-800c-5a40c7410179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cf9794f4104f639f0b7e80914ef8f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.408092 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 935/1896] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:40 2022] DELETE /identity/v3/users/29cf9794f4104f639f0b7e80914ef8f3 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:41.412661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.412948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.413229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.439478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:41.441325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.523222 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 936/1897] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:41.532705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.534034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.546358 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 962/1898] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:41.550972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.553046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.593383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837d33-3cfb-409f-b65f-7d550e7926e4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.619214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652885d4-4617-42aa-815a-bd7febff6007 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.625341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.626161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.626496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.627152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.628650 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.631620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.647342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.648215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.648654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.649907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.665301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.666791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.677924 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 937/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:41.827955 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 963/1900] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/users => generated 300 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:41.832191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.841888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7979-a60b-4c09-85c8-e410c165aac5 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.848256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.848997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.849172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.849451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.852024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.853643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.864834 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 938/1901] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:41.869004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.886430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2933815-dfda-4430-a2d3-6d0585480285 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.893487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.894384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.894765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.895175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.895886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.897583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b855-b280-4c6d-8e56-92d60ad8f1ca admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.907766 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 964/1902] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:41.912456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.922466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7190c-9e51-42a9-b522-d895b25e6fdd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.927642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.928334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.928618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.928893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] PATH_INFO: `/v3/projects/30d61ae0d4c54516b033f0afe2e8f3ce/users/2ddb3f55d4694975a4ac0cb1791859b8/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.943184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d61ae0d4c54516b033f0afe2e8f3ce, user_id=2ddb3f55d4694975a4ac0cb1791859b8, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.945934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.039780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:42.047472 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 939/1903] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:41 2022] PUT /identity/v3/projects/30d61ae0d4c54516b033f0afe2e8f3ce/users/2ddb3f55d4694975a4ac0cb1791859b8/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:42.058326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.058615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.058894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.087690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] MFA Rules not processed for user `2ddb3f55d4694975a4ac0cb1791859b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:42.089001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.152604 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 965/1904] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:42.157187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.213537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.213916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.220948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24e9e-6ec5-45b2-8575-ebfd9be4c2b9 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.226586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.227297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.227654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.227991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.228692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.230091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e182b-06b2-4c1b-b6f3-792fad2a45d3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.230965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.247124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.247859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.247967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.248259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] PATH_INFO: `/v3/projects/d4abe1e02bec42f19217b31d336df1ac` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.249556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4abe1e02bec42f19217b31d336df1ac)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.251663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.319728 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 940/1905] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:42 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:42.323737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.373980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4abe1e02bec42f19217b31d336df1ac', 'request_id': 'req-09037a85-82ff-49d8-803f-1d9cb344df63'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.384866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4abe1e02bec42f19217b31d336df1ac', 'request_id': 'req-09037a85-82ff-49d8-803f-1d9cb344df63'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.404669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4abe1e02bec42f19217b31d336df1ac', 'request_id': 'req-09037a85-82ff-49d8-803f-1d9cb344df63'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.413076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522cf28-a6cd-43d8-8117-d82a5d2ddc41 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.474063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.478831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.478831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.478831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.478831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.478831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.553063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] The token cache is being invalidate because project d4abe1e02bec42f19217b31d336df1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:42.553063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.553063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-09037a85-82ff-49d8-803f-1d9cb344df63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.553063 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 966/1906] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:42 2022] DELETE /identity/v3/projects/d4abe1e02bec42f19217b31d336df1ac => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:42.553737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.554027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.554446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.581795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] MFA Rules not processed for user `264ff114924043cb81e271513628e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:42.583648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.645872 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 967/1907] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:42.645872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.647077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.661705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd816876-877b-44da-b74b-b3a19fb4916b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.666545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.667192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.667455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.667730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] PATH_INFO: `/v3/users/eea4b0ab834949b988bd9daa7a3515d5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.668966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea4b0ab834949b988bd9daa7a3515d5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.670919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.746113 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 941/1908] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:42 2022] POST /identity/v3/users => generated 306 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:42.762377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.772212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.788560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776e546-75cd-4839-87c2-b0e89aae208a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.794577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.795483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.795981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.796352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.797096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.798879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.816620 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 942/1909] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:42.816620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.828050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a755bae-98e6-4d17-b20d-34522a752cf7 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.833731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.836316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.836316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.836316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] PATH_INFO: `/v3/projects/9b23418f9ac34d80b0dc816c0d811383/users/38199a3a6400469c953e04ce69326478/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.851573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23418f9ac34d80b0dc816c0d811383, user_id=38199a3a6400469c953e04ce69326478, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.854484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.912468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea4b0ab834949b988bd9daa7a3515d5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.926037 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 943/1910] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:42 2022] PUT /identity/v3/projects/9b23418f9ac34d80b0dc816c0d811383/users/38199a3a6400469c953e04ce69326478/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:42.934362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:43.015557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea4b0ab834949b988bd9daa7a3515d5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:43.035162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aed9a9-8b75-406a-aab3-3be32d5cb5c8 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:43.036495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea4b0ab834949b988bd9daa7a3515d5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:43.037443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea4b0ab834949b988bd9daa7a3515d5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:43.048116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:43.048763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:43.049268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:43.049618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:43.050973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:43.054318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc562f2-2a41-4d05-ac56-ef8d14be6642 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:43.055119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea4b0ab834949b988bd9daa7a3515d5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:43.068068 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 968/1911] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:42 2022] DELETE /identity/v3/users/eea4b0ab834949b988bd9daa7a3515d5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:43.074134 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 944/1912] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:43.075405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:43.077657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:43.079088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:43.160778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60190d7-69e6-45dd-a6d5-9fe4b92ad48f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:43.165549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:43.168354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:43.168354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:43.168354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] PATH_INFO: `/v3/projects/9b23418f9ac34d80b0dc816c0d811383/users/38199a3a6400469c953e04ce69326478/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:43.168955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b23418f9ac34d80b0dc816c0d811383, user_id=38199a3a6400469c953e04ce69326478, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:43.171745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:43.183374 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 969/1913] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:43 2022] PUT /identity/v3/projects/9b23418f9ac34d80b0dc816c0d811383/users/38199a3a6400469c953e04ce69326478/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:43.196077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:43.196362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:43.196854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:43.226598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] MFA Rules not processed for user `38199a3a6400469c953e04ce69326478`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:43.227793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:43.365482 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 945/1914] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:43.376663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:43.379467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:43.475243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472838b-4480-45c6-9098-06acaabe27ee admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:43.482465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:43.483257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:43.483651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:43.484039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:43.496249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:43.497818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:43.510640 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 970/1915] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:43.667307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:43.669254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:43.759327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f5fe4-8632-44ee-9e4c-1bf35e319244 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:43.766465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:43.766465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:43.766465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:43.766465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] PATH_INFO: `/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:43.767212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e0acde82e74a5bbc1fd5ac64d01dcf)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:43.769606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:43.996471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:44.005939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cefc51-ce01-4efe-a99a-5840f5d80cdd service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:44.009736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:44.010419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.010703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.010983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.012773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:44.078340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:44.079756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0cd9f-f20f-4e26-be59-b549d9be920b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:44.090187 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 971/1916] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:44.118851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e0acde82e74a5bbc1fd5ac64d01dcf', 'request_id': 'req-168b9c8a-7220-45cc-b865-32e41390ee58'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.126594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e0acde82e74a5bbc1fd5ac64d01dcf', 'request_id': 'req-168b9c8a-7220-45cc-b865-32e41390ee58'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.134120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e0acde82e74a5bbc1fd5ac64d01dcf', 'request_id': 'req-168b9c8a-7220-45cc-b865-32e41390ee58'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.276164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] The token cache is being invalidate because project 14e0acde82e74a5bbc1fd5ac64d01dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:44.276777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.278850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-168b9c8a-7220-45cc-b865-32e41390ee58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.281239 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 946/1917] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:43 2022] DELETE /identity/v3/projects/14e0acde82e74a5bbc1fd5ac64d01dcf => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:44.287447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.287750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.288947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.317237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:44.318955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:44.419067 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 972/1918] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:44.437964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.438286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.438670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.466174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:44.467570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:44.487572 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 947/1919] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:44.492052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:44.503361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e442-e5c7-4a3d-8fa2-6a4bfe44263a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:44.513096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:44.513608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.513923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.514195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.514854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:44.515154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:44.517549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:44.540953 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 973/1920] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:44.545386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:44.556293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122426-6ee5-4c45-8950-5a5646ea28b9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:44.564908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:44.565982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.566422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.566698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.567357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:44.569362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:44.770297 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 948/1921] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:44 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:44.771562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:44.784713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe64fa-3c0a-4d48-b62b-2af588df96d4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:44.883335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:44.884156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.884496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.885928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.885928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:44.888152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:44.939600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:45.004664 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 974/1922] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:44 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:45.009308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:45.028261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3390-5f87-4782-95e5-f2511ce9025d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:45.056394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:45.057241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.057694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.058000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.067480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:45.070364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:45.081658 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 949/1923] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:45.086330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:45.103164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18533a94-fb0a-4dc4-aab2-0f8f07a5e06c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:45.108981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:45.110105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.110559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.110833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.111567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:45.113917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f955a-f0f7-44b2-b115-ea06fd89be54 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:45.129300 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 975/1924] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:45.134681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:45.145438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f490-1854-43d9-8d49-1d0bb8212631 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:45.151066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:45.151836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.152357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.152737 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] PATH_INFO: `/v3/projects/6202197de9aa42e7b4edcd952d945712/users/7a9cdb994d1d488c84322d39a7234967/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.169351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6202197de9aa42e7b4edcd952d945712, user_id=7a9cdb994d1d488c84322d39a7234967, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:45.172423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:45.295385 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 950/1925] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:45 2022] PUT /identity/v3/projects/6202197de9aa42e7b4edcd952d945712/users/7a9cdb994d1d488c84322d39a7234967/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:45.317609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.317609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.317609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.361065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] MFA Rules not processed for user `7a9cdb994d1d488c84322d39a7234967`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:45.363534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:45.514832 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 976/1926] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:45.522005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:45.708145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa7f24-3ab2-4a88-8a3a-6a5cd1cc042a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:45.716527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:45.717576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.717944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.771977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.771977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:45.771977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.010278 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 951/1927] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:45 2022] POST /identity/v3/projects => generated 381 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:46.010576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.040483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f2af4-c6dc-40da-bbbe-c0f929c3d353 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.046754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:46.153144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.153933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.168593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.171585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.174426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.181111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.307658 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 977/1928] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:46 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:46.311628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.328219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83ffd3-0696-4198-8853-0c46f9941012 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.341262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.342924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.343396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.343676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.344511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.347461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.361669 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 952/1929] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:46.366928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.379198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007f7cb-f229-4e2c-9191-59473c48ec89 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.384023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.384886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.385176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.385449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] PATH_INFO: `/v3/projects/da7067642a964ff9bac5b7aeb07d46ae/users/0154c54bdf304947bff626b9f5b65a80/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.405070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7067642a964ff9bac5b7aeb07d46ae, user_id=0154c54bdf304947bff626b9f5b65a80, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.407823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.583402 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 978/1930] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:46 2022] PUT /identity/v3/projects/da7067642a964ff9bac5b7aeb07d46ae/users/0154c54bdf304947bff626b9f5b65a80/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:46.586452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.596464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c884-499a-43a8-8422-88c9e6cc4a54 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.668514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:46.684248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.684870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.685505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.685505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.686107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.687920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845eb5e-83f7-4384-ac80-52b8a70bbccb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.701465 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 953/1931] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:46.705447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.715961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9d4b5-a1d4-45d0-b065-b5202d262aa2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.721142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.722177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.722695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.722980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] PATH_INFO: `/v3/projects/da7067642a964ff9bac5b7aeb07d46ae/users/0154c54bdf304947bff626b9f5b65a80/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.724903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7067642a964ff9bac5b7aeb07d46ae, user_id=0154c54bdf304947bff626b9f5b65a80, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.727798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.739635 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 979/1932] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:46 2022] PUT /identity/v3/projects/da7067642a964ff9bac5b7aeb07d46ae/users/0154c54bdf304947bff626b9f5b65a80/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:46.750609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb736-2085-4556-8c55-8241175ed233 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.750903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb736-2085-4556-8c55-8241175ed233 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.751210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb736-2085-4556-8c55-8241175ed233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.780485 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-391bb736-2085-4556-8c55-8241175ed233 None None] MFA Rules not processed for user `0154c54bdf304947bff626b9f5b65a80`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:46.788243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-391bb736-2085-4556-8c55-8241175ed233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:46.870893 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 954/1933] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:46.879180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.881439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:46.962944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cae8-eab3-456c-8106-41c94e5f5304 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.967103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.967715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.968509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.968509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.982610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.984126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21ffa-e017-4cd9-800b-69ae316b673b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.997661 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 980/1934] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:47.935310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:48.508236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:48.648113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb736-2085-4556-8c55-8241175ed233 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:48.715349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb736-2085-4556-8c55-8241175ed233 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:48.720216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:48.725269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:48.725269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:48.725269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] PATH_INFO: `/v3/users/7a9cdb994d1d488c84322d39a7234967` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:48.725269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9cdb994d1d488c84322d39a7234967)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:48.725902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:48.819392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e6e7-1632-4a3e-9fed-c542b54d17fa None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:48.820019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e6e7-1632-4a3e-9fed-c542b54d17fa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:48.820393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7e6e7-1632-4a3e-9fed-c542b54d17fa None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:48.822116 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 981/1935] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:48.829447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:48.829711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:48.830025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:48.852424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:48.854271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:48.988454 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 982/1936] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:48.996368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9cdb994d1d488c84322d39a7234967'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:49.007307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9cdb994d1d488c84322d39a7234967'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:49.010299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:49.012407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:49.034584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946c36-47e6-47bd-bd52-8b8540d90b61 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:49.041213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:49.041933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:49.042356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:49.042776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:49.054952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:49.056369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f38777-6cea-4ae5-ae8d-055bdd95b359 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:49.067495 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 983/1937] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:49.203209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9cdb994d1d488c84322d39a7234967'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:49.203827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9cdb994d1d488c84322d39a7234967'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:49.217368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9cdb994d1d488c84322d39a7234967'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:49.226520 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 955/1938] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:48 2022] DELETE /identity/v3/users/7a9cdb994d1d488c84322d39a7234967 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:49.232338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:49.232889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:49.233406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:49.254610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:49.256298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:49.319498 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 984/1939] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:49.331404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:49.333267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:49.411623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5394-1ee1-4ee7-bbf4-50c8d5b8fa43 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:49.415721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:49.416366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:49.416651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:49.418187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:49.427526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:49.429021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:49.439677 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 956/1940] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:50.015453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:50.019109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:50.041737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae46b2b-5190-4b05-a256-c749df72e7d3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:50.054079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:50.054079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:50.054079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:50.054079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] PATH_INFO: `/v3/projects/6202197de9aa42e7b4edcd952d945712` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:50.054828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6202197de9aa42e7b4edcd952d945712)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:50.054828 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:50.240412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6202197de9aa42e7b4edcd952d945712', 'request_id': 'req-46c6bea7-91ad-4668-966e-a1292cfac583'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.245793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6202197de9aa42e7b4edcd952d945712', 'request_id': 'req-46c6bea7-91ad-4668-966e-a1292cfac583'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.252023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6202197de9aa42e7b4edcd952d945712', 'request_id': 'req-46c6bea7-91ad-4668-966e-a1292cfac583'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.328119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] The token cache is being invalidate because project 6202197de9aa42e7b4edcd952d945712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:50.328410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.329047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.330741 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 985/1941] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:50 2022] DELETE /identity/v3/projects/6202197de9aa42e7b4edcd952d945712 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:50.335101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:50.345772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600384fd-02c7-487a-9400-3ecde66d905a service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:50.421219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:50.422361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:50.422650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:50.422932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] PATH_INFO: `/v3/users/0154c54bdf304947bff626b9f5b65a80` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:50.424963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0154c54bdf304947bff626b9f5b65a80)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:50.434404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:50.752394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0154c54bdf304947bff626b9f5b65a80'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.760154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0154c54bdf304947bff626b9f5b65a80'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.932665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0154c54bdf304947bff626b9f5b65a80'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.933290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0154c54bdf304947bff626b9f5b65a80'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.953415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0154c54bdf304947bff626b9f5b65a80'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:50.970304 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 957/1942] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:50 2022] DELETE /identity/v3/users/0154c54bdf304947bff626b9f5b65a80 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:51.045109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:51.048671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.085589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6bea7-91ad-4668-966e-a1292cfac583 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:51.162486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:51.163133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.163630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.163908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] PATH_INFO: `/v3/users/82f52e4645a84e5cbcfa92a222651040` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.165391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f52e4645a84e5cbcfa92a222651040)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:51.167517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:51.404330 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:51.448207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f52e4645a84e5cbcfa92a222651040'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.450768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:51.452493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.466602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32d58-7d68-48d4-810b-23c6efef32f4 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:51.471506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:51.472168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.472448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.472725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] PATH_INFO: `/v3/users/2ddb3f55d4694975a4ac0cb1791859b8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.473915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddb3f55d4694975a4ac0cb1791859b8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:51.475899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:51.624771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f52e4645a84e5cbcfa92a222651040'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.635216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f52e4645a84e5cbcfa92a222651040'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.636214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f52e4645a84e5cbcfa92a222651040'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.649708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02367632-a3f0-4ad9-b8c5-94f6fda21a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f52e4645a84e5cbcfa92a222651040'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.656989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:51.664465 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 986/1943] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:51 2022] DELETE /identity/v3/users/82f52e4645a84e5cbcfa92a222651040 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:51.666461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.666755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.667746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.706955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:51.706955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.771495 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 987/1944] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:51.783372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:51.786551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.801432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddb3f55d4694975a4ac0cb1791859b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.825643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddb3f55d4694975a4ac0cb1791859b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:51.893384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b530f3f-7a06-4f07-bb8f-052f5e097fb6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:51.898681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:51.899619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.899905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.900183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.919687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:51.946019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:51.946019 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 988/1945] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:52.092677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddb3f55d4694975a4ac0cb1791859b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.093368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddb3f55d4694975a4ac0cb1791859b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.103674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.103674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.110140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2309c315-ef7a-4b66-b925-18578458b3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddb3f55d4694975a4ac0cb1791859b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.117092 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 958/1946] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:51 2022] DELETE /identity/v3/users/2ddb3f55d4694975a4ac0cb1791859b8 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:52.124459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.124810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.125033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.136659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0928bf-137f-4007-99bc-b7e1b3a20673 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.160831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:52.162268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.253775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.255472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.256113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.256402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] PATH_INFO: `/v3/projects/da7067642a964ff9bac5b7aeb07d46ae` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.262194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7067642a964ff9bac5b7aeb07d46ae)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.262194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:52.306419 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 959/1947] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:52.346132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.353301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.459287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7067642a964ff9bac5b7aeb07d46ae', 'request_id': 'req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.459287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7067642a964ff9bac5b7aeb07d46ae', 'request_id': 'req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.459287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7067642a964ff9bac5b7aeb07d46ae', 'request_id': 'req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.470690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd42b83-472f-4101-94ca-5ac624ef234a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.567637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] The token cache is being invalidate because project da7067642a964ff9bac5b7aeb07d46ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:52.568591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.570025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.571123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:52.573328 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 989/1948] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:52 2022] DELETE /identity/v3/projects/da7067642a964ff9bac5b7aeb07d46ae => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:52.574188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.574922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.575253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.575533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.577693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.594243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.748727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c646a-c0f2-4280-bc60-bbe0d3fc3a54 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.749075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.749163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.749163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.749163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.749486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17ceb1-f262-462c-99e7-72fdfc8625a0 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:52.749565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] PATH_INFO: `/v3/projects/f0e2f615b5b5430ca5a04617c832cc6e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.749565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e2f615b5b5430ca5a04617c832cc6e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.749565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:52.749813 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 960/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:52.751762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729645-3dbd-465e-a73f-04f9ec485c96 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.753703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729645-3dbd-465e-a73f-04f9ec485c96 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.754436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729645-3dbd-465e-a73f-04f9ec485c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.785440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-fc729645-3dbd-465e-a73f-04f9ec485c96 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:52.786690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fc729645-3dbd-465e-a73f-04f9ec485c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.795388 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 961/1950] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:52.806951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.807600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.808106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.832388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:52.833905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.845876 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 962/1951] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:52.848938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.872426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f88fe-41d1-4112-a85d-2fb7cf1d7a6b None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.881209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.882281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.882529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.882859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.883580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:52.883840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.885447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:52.900732 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 963/1952] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:52.907047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.919399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bd4b-1c79-4c89-97b1-8c30be1e9448 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.925039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.925654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.925973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.926252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.926882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.928977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.010154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e2f615b5b5430ca5a04617c832cc6e', 'request_id': 'req-79e43e18-adbb-4216-a9e2-956771583f3e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.039396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e2f615b5b5430ca5a04617c832cc6e', 'request_id': 'req-79e43e18-adbb-4216-a9e2-956771583f3e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.046406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e2f615b5b5430ca5a04617c832cc6e', 'request_id': 'req-79e43e18-adbb-4216-a9e2-956771583f3e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.100269 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 964/1953] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:52 2022] POST /identity/v3/projects => generated 359 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:53.104401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.170518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] The token cache is being invalidate because project f0e2f615b5b5430ca5a04617c832cc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:53.178441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.178441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.178990 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 990/1954] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:52 2022] DELETE /identity/v3/projects/f0e2f615b5b5430ca5a04617c832cc6e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:53.180406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.182468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.225350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a4-1643-40dc-97ac-d1ba455d19fc admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.232407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.233403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.234063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.234715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.235670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.240171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.274149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43e18-adbb-4216-a9e2-956771583f3e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.292578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.293748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.295583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.295966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] PATH_INFO: `/v3/users/3b9b0b7aa98d4e14826bc9f997eb89c4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.306696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9b0b7aa98d4e14826bc9f997eb89c4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.308468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.333066 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 965/1955] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:53 2022] POST /identity/v3/users => generated 280 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:53.338334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.340335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.363429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958482-3663-456f-b54f-00f6b6f7d81d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.372718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.373549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.373980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.374306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.375028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.376814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.400626 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 966/1956] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:53.405661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.428331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488877d9-c568-41bd-9830-4781195e1fc1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.433745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.434703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.434992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.435275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.435954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.437564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.449111 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 967/1957] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:53.453729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.464038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0aecf-84a1-44bd-a8e9-6c53b4909c07 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.468749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.469406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.469690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.470003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] PATH_INFO: `/v3/projects/cf2119df7881452dbff058db6913f223/users/0260a94f149d4db5af25a8088295ad9f/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.485561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2119df7881452dbff058db6913f223, user_id=0260a94f149d4db5af25a8088295ad9f, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.488501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.541303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:53.583326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9b0b7aa98d4e14826bc9f997eb89c4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.623663 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 968/1958] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:53 2022] PUT /identity/v3/projects/cf2119df7881452dbff058db6913f223/users/0260a94f149d4db5af25a8088295ad9f/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:53.625050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.627143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.710160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014ffe-43b6-496f-9dd6-43f6dac1f78a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.718586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.719233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.719945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.719945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] PATH_INFO: `/v3/projects/30d61ae0d4c54516b033f0afe2e8f3ce` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.721490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d61ae0d4c54516b033f0afe2e8f3ce)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.723405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.797694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9b0b7aa98d4e14826bc9f997eb89c4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.804995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9b0b7aa98d4e14826bc9f997eb89c4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.805652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9b0b7aa98d4e14826bc9f997eb89c4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.819396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc6c7324-4c30-470b-b6cc-3e938a33b062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9b0b7aa98d4e14826bc9f997eb89c4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.825509 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 991/1959] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:53 2022] DELETE /identity/v3/users/3b9b0b7aa98d4e14826bc9f997eb89c4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:53.827067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.827358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.827687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.859917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] MFA Rules not processed for user `0260a94f149d4db5af25a8088295ad9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:53.861143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.928153 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 992/1960] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:53.945970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d61ae0d4c54516b033f0afe2e8f3ce', 'request_id': 'req-ae777344-308c-4f12-9809-dc1dc7627423'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.952944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d61ae0d4c54516b033f0afe2e8f3ce', 'request_id': 'req-ae777344-308c-4f12-9809-dc1dc7627423'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.963337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d61ae0d4c54516b033f0afe2e8f3ce', 'request_id': 'req-ae777344-308c-4f12-9809-dc1dc7627423'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:53.967081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.968578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.029442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64b645-ab61-4206-ba18-92cc59f80519 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.043794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] The token cache is being invalidate because project 30d61ae0d4c54516b033f0afe2e8f3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:54.043794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.043794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.043794 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 969/1961] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:53 2022] DELETE /identity/v3/projects/30d61ae0d4c54516b033f0afe2e8f3ce => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:54.045940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.047768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.086741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.089532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.089532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.089532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.091231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.145022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777344-308c-4f12-9809-dc1dc7627423 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.149855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.150777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.151071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.151370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] PATH_INFO: `/v3/users/38199a3a6400469c953e04ce69326478` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.152583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38199a3a6400469c953e04ce69326478)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.154572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.162516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.163981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.173302 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 993/1962] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:54.189116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.191597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.207035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5487-fc17-4397-a104-4b8944ed3d67 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.212426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.213181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.213560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.213778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] PATH_INFO: `/v3/users/0260a94f149d4db5af25a8088295ad9f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.215045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0260a94f149d4db5af25a8088295ad9f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.217314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.449704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38199a3a6400469c953e04ce69326478'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.449704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38199a3a6400469c953e04ce69326478'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.482068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0260a94f149d4db5af25a8088295ad9f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.579705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38199a3a6400469c953e04ce69326478'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.581117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38199a3a6400469c953e04ce69326478'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.602252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38199a3a6400469c953e04ce69326478'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.610426 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 970/1963] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:54 2022] DELETE /identity/v3/users/38199a3a6400469c953e04ce69326478 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:54.612429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.619073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.703593 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1376f4a-765e-4cb1-acc1-92c881a1d9f9 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.709562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.710282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.710574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.710857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] PATH_INFO: `/v3/projects/f350284549ce4f8eb40ade452694e45f` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.712303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f350284549ce4f8eb40ade452694e45f)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.716343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.768821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0260a94f149d4db5af25a8088295ad9f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.776809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0260a94f149d4db5af25a8088295ad9f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.777492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0260a94f149d4db5af25a8088295ad9f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.790520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a29d7f5-306b-47da-be69-0f6ba4401a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0260a94f149d4db5af25a8088295ad9f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.796884 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 994/1964] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:54 2022] DELETE /identity/v3/users/0260a94f149d4db5af25a8088295ad9f => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:54.802538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.802538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.802737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.821520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:54.822747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:54.904353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:54.906587 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 995/1965] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:54.913302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f350284549ce4f8eb40ade452694e45f', 'request_id': 'req-bec064da-43b9-4435-842b-e32f8b64746a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.919071 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f350284549ce4f8eb40ade452694e45f', 'request_id': 'req-bec064da-43b9-4435-842b-e32f8b64746a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.925627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f350284549ce4f8eb40ade452694e45f', 'request_id': 'req-bec064da-43b9-4435-842b-e32f8b64746a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:54.937400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.939714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.010112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493be6-6a5c-486d-9105-76e8d61c7666 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.019956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] The token cache is being invalidate because project f350284549ce4f8eb40ade452694e45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:55.020360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.021770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bec064da-43b9-4435-842b-e32f8b64746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.023465 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 971/1966] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:54 2022] DELETE /identity/v3/projects/f350284549ce4f8eb40ade452694e45f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:55.027998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f7bbd-81dc-423e-b420-65195274356f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.028465 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f7bbd-81dc-423e-b420-65195274356f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.028801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f7bbd-81dc-423e-b420-65195274356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.055549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f07f7bbd-81dc-423e-b420-65195274356f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:55.056817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f07f7bbd-81dc-423e-b420-65195274356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.091779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.094779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.094779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.094779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.095032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.155455 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 972/1967] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:55.164261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.165573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.165573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.185320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:55.185698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.186559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.187386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.195538 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 973/1968] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:55.198310 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 996/1969] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:55.199787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.210407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2ed84-acaf-430e-9fdd-0f9c72ff4695 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.215382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.215809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.216093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.216370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.217021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:55.217328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.219032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.231081 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 974/1970] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:55.235563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.245575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750879f-a009-49da-89c9-7ea3e06f49c3 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.250118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.250708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.251609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.251893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.253203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.255598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.270848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.272707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.291098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ddcc-253c-4430-a34f-3e92c34a9f49 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.297348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.298269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.298623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.299323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] PATH_INFO: `/v3/projects/9b23418f9ac34d80b0dc816c0d811383` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.300476 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b23418f9ac34d80b0dc816c0d811383)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.302558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.387751 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 997/1971] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:55.392065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.433618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b23418f9ac34d80b0dc816c0d811383', 'request_id': 'req-94081b6e-7e12-4614-bf76-ac6389eb2b49'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.440889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b23418f9ac34d80b0dc816c0d811383', 'request_id': 'req-94081b6e-7e12-4614-bf76-ac6389eb2b49'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.449245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b23418f9ac34d80b0dc816c0d811383', 'request_id': 'req-94081b6e-7e12-4614-bf76-ac6389eb2b49'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.480131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250841cb-346c-467f-94a0-89d0dfdf55f2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.529045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] The token cache is being invalidate because project 9b23418f9ac34d80b0dc816c0d811383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:55.534231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.534231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-94081b6e-7e12-4614-bf76-ac6389eb2b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:55.534231 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 975/1972] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:55 2022] DELETE /identity/v3/projects/9b23418f9ac34d80b0dc816c0d811383 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:55.537805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459883-4cc4-4c66-8860-6a54cc7760c6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.538204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459883-4cc4-4c66-8860-6a54cc7760c6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.538610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459883-4cc4-4c66-8860-6a54cc7760c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.543538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.544592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.544886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.545225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.546401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.549642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.560700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-63459883-4cc4-4c66-8860-6a54cc7760c6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:55.562179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-63459883-4cc4-4c66-8860-6a54cc7760c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.570377 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 976/1973] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:55.578916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.579280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.579569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.609566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:55.611536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.631155 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 977/1974] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:55.644786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.654502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ba218-71e7-4975-9eae-a5070d23d89e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.672375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.672375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.672375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.672375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.672745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:55.672745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.672745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.677221 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 978/1975] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:17:55.681539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.691619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699c1ba-2f8a-472a-921e-61e46aae9b05 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.696390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.696990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.697279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.697558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.698216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.700271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.793908 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 998/1976] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/users => generated 290 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:55.795861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.797491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.809911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f381d-bb1a-41e3-9c99-c5b7aff4fc5f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.816411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.816719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.817057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.817406 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 979/1977] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:55.820462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.821243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.822910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.824232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.853216 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 999/1978] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:55.853216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:55.859968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:55.874854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384584dc-815b-4657-b2bc-e92d32ea1aae admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.935653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d281-a9ef-4ff2-8154-fb67b3bfd5c3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:55.941310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.941970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.942381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.942670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.943328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.945306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:55.970326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:55.970993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:55.971282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:55.971554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] PATH_INFO: `/v3/projects/cf2119df7881452dbff058db6913f223` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:55.972708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2119df7881452dbff058db6913f223)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:55.975925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.062000 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 980/1979] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:55 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:56.062000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.070156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60714d2-cd12-49d0-825c-a113b74a0492 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.074823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.075416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.075701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.076232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.076875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.078658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.092461 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 981/1980] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:56.093385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.106143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a193-a9f0-4139-a333-413db74d39d4 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.135029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2119df7881452dbff058db6913f223', 'request_id': 'req-3e3b180e-5071-45f5-aeb4-105d15936f13'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:56.152700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2119df7881452dbff058db6913f223', 'request_id': 'req-3e3b180e-5071-45f5-aeb4-105d15936f13'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:56.166493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2119df7881452dbff058db6913f223', 'request_id': 'req-3e3b180e-5071-45f5-aeb4-105d15936f13'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:56.231763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.233306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] The token cache is being invalidate because project cf2119df7881452dbff058db6913f223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:56.234193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:56.235046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:56.237873 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1000/1981] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:55 2022] DELETE /identity/v3/projects/cf2119df7881452dbff058db6913f223 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:56.238863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.242215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.243486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.244148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.244533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.245398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.247564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f68ab-6940-4376-bfcb-b962bf0743bb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.259315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b180e-5071-45f5-aeb4-105d15936f13 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.264165 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 982/1982] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:56.265352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.266069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.266456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.266614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.267180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.267380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.268494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] PATH_INFO: `/v3/projects/7467ad0012b84a18a052fed704bd4170/users/b5142d9806644ac088b7fe2d82d841dd/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.297866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:56.300323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.303398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7467ad0012b84a18a052fed704bd4170, user_id=b5142d9806644ac088b7fe2d82d841dd, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.306284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.315690 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 983/1983] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:56.316895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.327689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.358418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee9350-721a-4f30-8d56-d419daad37cf None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.364963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.365590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.365904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.366178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.366823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.368524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851329d-31eb-451b-bf85-a48a0b163964 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.380154 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 984/1984] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:56.381407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b81d5-d520-4100-98ad-b8090be4dd3c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.381690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b81d5-d520-4100-98ad-b8090be4dd3c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.381991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b81d5-d520-4100-98ad-b8090be4dd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.395633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:56.403733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5c1b81d5-d520-4100-98ad-b8090be4dd3c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:56.404336 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1001/1985] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:56 2022] PUT /identity/v3/projects/7467ad0012b84a18a052fed704bd4170/users/b5142d9806644ac088b7fe2d82d841dd/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:56.405125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.405248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5c1b81d5-d520-4100-98ad-b8090be4dd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.466917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7af72-be13-4187-bdbb-2b6c0c2af152 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.469005 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 985/1986] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:56.470388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef18d-1ee8-4d33-badc-0b5911019e8b None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.470710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef18d-1ee8-4d33-badc-0b5911019e8b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.471070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef18d-1ee8-4d33-badc-0b5911019e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.474960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.475805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.476084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.476354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] PATH_INFO: `/v3/projects/95d307b5c73647b99396f19bc7ef676b/users/181870dc52884c3da93545754cded2b6/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.491745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d307b5c73647b99396f19bc7ef676b, user_id=181870dc52884c3da93545754cded2b6, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.494628 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.500643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-aceef18d-1ee8-4d33-badc-0b5911019e8b None None] MFA Rules not processed for user `b5142d9806644ac088b7fe2d82d841dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:56.502794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aceef18d-1ee8-4d33-badc-0b5911019e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.567089 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1002/1987] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:56 2022] PUT /identity/v3/projects/95d307b5c73647b99396f19bc7ef676b/users/181870dc52884c3da93545754cded2b6/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:56.568111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.570405 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 986/1988] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:56.575164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.575510 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.575785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.599344 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:56.600851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.639087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11a623-b1b5-4b33-bd94-fdaf7d968ba6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.644683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.645301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.645588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.645895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.646552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:56.646863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.648486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.661438 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1003/1989] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:56.661910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.670920 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 987/1990] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:56.671592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4a0d-0565-4400-83e7-abe7942dacdb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.671809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.678483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.682664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.682664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.682664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.682664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.682971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf105e1-1af0-40ed-bab4-2e1bdabd8c30 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.683053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.686628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.687246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.687535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.687938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.688556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.691117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.787579 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1004/1991] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:56.787579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.788037 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 988/1992] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:56.788203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.797101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.854316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f6ff9-5c13-4207-9c91-9c4704c89a6f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.910827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9cf1-fe0d-4df7-8785-82bb91aed782 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.915897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.916520 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.916939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.917388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.918063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.920014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.925772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.926448 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.926744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.927087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.937245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.938746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.951756 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1005/1993] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:56.952599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.963873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2211887-3c2a-4301-8992-a24d7839897f service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.969771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.969947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.970222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.970504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.971323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.979198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.101777 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 989/1994] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:57.116964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.116964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee18cc1-b6cd-4357-b96d-76f563f64185 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.124387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.125052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.125522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.125873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.126716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.128987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.144173 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 990/1995] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:57.148492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.166201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17dd7b-45a7-4f33-874d-db1a0ea7de46 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.197803 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1006/1996] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:57.197947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.197947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.197947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.197947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.198238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.198238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.198238 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 991/1997] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:57.200152 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.200269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.212533 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c201e-cdd6-4dc4-8ae1-6f835d899090 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.215098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5271-72df-431c-a0d0-4e427c4a7d3f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.217725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.218583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.218941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.219324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] PATH_INFO: `/v3/projects/c58847206e884cf9a2e50f2cd26801d8/users/e945b19378fb4e8fb981a9836d8b2950/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.222316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.222916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.223199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.223500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.224252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.226541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.238844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58847206e884cf9a2e50f2cd26801d8, user_id=e945b19378fb4e8fb981a9836d8b2950, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.239909 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 992/1998] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:57.242096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162afb-2f91-4bd9-82e4-246845a06b39 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.244370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.256533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363fe74-8845-49ba-809d-7d9611e023ee admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.262237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.263044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.263575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.263575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] PATH_INFO: `/v3/projects/7022f64a09064ebe81974e38abb52579/users/ac96c339a0d34bf1bb0b42d7f03fa1f5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.280029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7022f64a09064ebe81974e38abb52579, user_id=ac96c339a0d34bf1bb0b42d7f03fa1f5, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.282504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.384486 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1007/1999] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:57 2022] PUT /identity/v3/projects/c58847206e884cf9a2e50f2cd26801d8/users/e945b19378fb4e8fb981a9836d8b2950/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:57.385926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.386127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.386614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.397678 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 993/2000] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:57 2022] PUT /identity/v3/projects/7022f64a09064ebe81974e38abb52579/users/ac96c339a0d34bf1bb0b42d7f03fa1f5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:57.398772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.471340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] MFA Rules not processed for user `e945b19378fb4e8fb981a9836d8b2950`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:57.477097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:57.501134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428228-23e5-4a72-88e0-68c0a69a3e91 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.507855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.508972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.509327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.509683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.511016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.512858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.527973 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 994/2001] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:57.537645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.561431 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b47bea-d747-4244-b743-5728d6bbd071 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.569811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.570578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.570881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.571140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] PATH_INFO: `/v3/projects/7022f64a09064ebe81974e38abb52579/users/ac96c339a0d34bf1bb0b42d7f03fa1f5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.573526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7022f64a09064ebe81974e38abb52579, user_id=ac96c339a0d34bf1bb0b42d7f03fa1f5, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.576951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d52-abc8-449b-888a-5260cabc3298 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.620544 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 995/2002] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:57 2022] PUT /identity/v3/projects/7022f64a09064ebe81974e38abb52579/users/ac96c339a0d34bf1bb0b42d7f03fa1f5/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:57.631780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.632033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.632268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.710047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] MFA Rules not processed for user `ac96c339a0d34bf1bb0b42d7f03fa1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:57.711424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:57.719543 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1008/2003] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:57.730185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.732365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:57.764099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:57.834052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074e85-e3b1-4c7d-8dd2-e0b79dc342ed None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.863920 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 996/2004] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:57.890652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.891182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.891464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.891739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:57.957406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:57.959101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96fc10-b0df-4676-add8-bbce20a53ffc service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:57.967020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:57.968429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:57.983618 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1009/2005] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:57.993554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb089d4-b197-4a43-997a-a6712f798789 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:57.997252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:57.997890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:57.998177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:57.998453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:58.058415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:58.060146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:58.083779 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 997/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:58.653089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:58.957614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:58.981215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:58.981983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:58.983012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.072261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] MFA Rules not processed for user `181870dc52884c3da93545754cded2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:59.073526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:59.213078 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1010/2007] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:59.217556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.291345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b013427-69da-478e-9347-5db7549cd2d5 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:59.297398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:59.301526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.301526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.301526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.301526 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:59.302338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:59.497120 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 998/2008] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:59 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:59.501332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.512224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347d32-c447-488d-89e9-f016568b5d35 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:59.571904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:59.572526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.572811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.573088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.573724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:59.575722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:59.726835 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1011/2009] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:59 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:59.728087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.738619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08831e-61da-40ba-a4bc-fe8c4c310060 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:59.743418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:59.744041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.744326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.744603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.745265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:59.746889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:59.758324 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 999/2010] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:59.762979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.776161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bad652-1c8b-48f4-b10e-7abdcdcd0aba admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:59.780688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:59.781585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.781893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.782174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] PATH_INFO: `/v3/projects/3afefa4e157643f2b535ac1bc9a601cd/users/ff4a5092538c4dde83110dbd7b82d666/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.797306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afefa4e157643f2b535ac1bc9a601cd, user_id=ff4a5092538c4dde83110dbd7b82d666, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:59.800463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:59.872273 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1012/2011] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:59 2022] PUT /identity/v3/projects/3afefa4e157643f2b535ac1bc9a601cd/users/ff4a5092538c4dde83110dbd7b82d666/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:59.876145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.887200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9f48-9c48-4144-844a-108c48c454ff admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:59.960470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:59.962549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.962549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.962549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.962803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:59.964420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:59.980097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1000/2012] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:59.980873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:59.995770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74f20-5b8a-417d-9b7a-efad07cf4f9a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:00.002446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:00.005710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:00.005710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:00.005710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] PATH_INFO: `/v3/projects/3afefa4e157643f2b535ac1bc9a601cd/users/ff4a5092538c4dde83110dbd7b82d666/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:00.005710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afefa4e157643f2b535ac1bc9a601cd, user_id=ff4a5092538c4dde83110dbd7b82d666, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:00.008746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2f042-810c-4859-9561-5edf459e612b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:00.030110 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1013/2013] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:59 2022] PUT /identity/v3/projects/3afefa4e157643f2b535ac1bc9a601cd/users/ff4a5092538c4dde83110dbd7b82d666/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:00.586628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:01.066535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:01.223315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:01.301411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c37a-719c-49f5-9627-8cc30906e081 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:01.354962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:01.355717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:01.356034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:01.356307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:01.449700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:01.452109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f194ae-76ca-4614-b71b-67a87c326009 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:01.463852 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1001/2014] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:01.650310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d7df6-f9f9-4355-87f4-225d3a0de3bc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:01.650852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d7df6-f9f9-4355-87f4-225d3a0de3bc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:01.651483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d7df6-f9f9-4355-87f4-225d3a0de3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:01.715661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e27107-865d-4516-b2b5-9a96536cc110 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:01.715661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e27107-865d-4516-b2b5-9a96536cc110 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:01.715661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e27107-865d-4516-b2b5-9a96536cc110 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:01.717067 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1002/2015] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:18:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:18:01.727373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:01.727811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:01.728165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:01.771405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-166d7df6-f9f9-4355-87f4-225d3a0de3bc None None] MFA Rules not processed for user `ff4a5092538c4dde83110dbd7b82d666`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:01.775219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-166d7df6-f9f9-4355-87f4-225d3a0de3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:01.783471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:01.787138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:01.898913 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1014/2016] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:01.907088 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1003/2017] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:01.909624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:01.909948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:01.910228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:01.930565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] MFA Rules not processed for user `181870dc52884c3da93545754cded2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:01.931957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:01.938409 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:01.997198 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1015/2018] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:02.032620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:02.035208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:02.049801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6505-c31f-4c4a-b986-4ce220c94aed None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:02.056108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:02.056752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:02.061642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:02.061642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:02.067177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:02.068782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:02.080457 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1004/2019] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:02.121603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:02.138232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6050f4e-3174-42a9-aba3-2af7b9f2fa18 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:02.144964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:02.150457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:02.150457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:02.150457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:02.154375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:02.155978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786c1ab-8fd9-4371-9fda-bbcc6109b4b3 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:02.165216 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1016/2020] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:03.151930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:04.643477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:05.989209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:06.600926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:07.049278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:08.016573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:08.089738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7820-07a3-40ac-a2fb-1e28d733db73 service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:08.094614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:08.095463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:08.095811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:08.096092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] PATH_INFO: `/v3/users/b5142d9806644ac088b7fe2d82d841dd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:08.097231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5142d9806644ac088b7fe2d82d841dd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:08.099233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:08.151927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:08.349590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5142d9806644ac088b7fe2d82d841dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:08.359770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5142d9806644ac088b7fe2d82d841dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:08.492437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5142d9806644ac088b7fe2d82d841dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:08.495312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5142d9806644ac088b7fe2d82d841dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:08.511653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5142d9806644ac088b7fe2d82d841dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:08.521799 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1005/2021] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:08 2022] DELETE /identity/v3/users/b5142d9806644ac088b7fe2d82d841dd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:08.523453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:08.523896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:08.524001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:08.543987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:08.545285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:08.579604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:08.614481 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1017/2022] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:08.624200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:08.625602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:08.686004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69e378-3205-4dcd-b47d-f80d6ab44156 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:08.690528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:08.691336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:08.691623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:08.691901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:08.702792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:08.705312 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:08.716817 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1006/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:09.227078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:09.228677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:09.252723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec63d6-07f6-4377-95eb-48d560e07cd3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:09.281073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:09.281746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:09.282055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:09.282529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] PATH_INFO: `/v3/projects/7467ad0012b84a18a052fed704bd4170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:09.298728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7467ad0012b84a18a052fed704bd4170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:09.300724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:09.317518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:09.509561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7467ad0012b84a18a052fed704bd4170', 'request_id': 'req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:09.518283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7467ad0012b84a18a052fed704bd4170', 'request_id': 'req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:09.521182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:09.534417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7467ad0012b84a18a052fed704bd4170', 'request_id': 'req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:09.683228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] The token cache is being invalidate because project 7467ad0012b84a18a052fed704bd4170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:09.683539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:09.684288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:09.686321 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1018/2024] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:09 2022] DELETE /identity/v3/projects/7467ad0012b84a18a052fed704bd4170 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:09.690596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:09.702073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886a41-3d0f-4adc-8115-8cfa75764bf0 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:09.858609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:09.859254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:09.859559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:09.859954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] PATH_INFO: `/v3/users/ac96c339a0d34bf1bb0b42d7f03fa1f5` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:09.862556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac96c339a0d34bf1bb0b42d7f03fa1f5)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:09.866102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:10.067963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac96c339a0d34bf1bb0b42d7f03fa1f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.077298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac96c339a0d34bf1bb0b42d7f03fa1f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.154505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac96c339a0d34bf1bb0b42d7f03fa1f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.155684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac96c339a0d34bf1bb0b42d7f03fa1f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.169618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec5aaaee-ab7d-4815-949a-3e96e517090c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac96c339a0d34bf1bb0b42d7f03fa1f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.176479 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1007/2025] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:09 2022] DELETE /identity/v3/users/ac96c339a0d34bf1bb0b42d7f03fa1f5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:10.569727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:10.571279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:10.585636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7beb0a-3c95-43e6-9f67-27b92ce938e1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:10.644941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:10.645500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:10.645780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:10.646090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] PATH_INFO: `/v3/projects/7022f64a09064ebe81974e38abb52579` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:10.647227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7022f64a09064ebe81974e38abb52579)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:10.649128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:10.784995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7022f64a09064ebe81974e38abb52579', 'request_id': 'req-acdc555f-137a-47f1-8d15-b19e8a3811a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.790633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7022f64a09064ebe81974e38abb52579', 'request_id': 'req-acdc555f-137a-47f1-8d15-b19e8a3811a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.796754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7022f64a09064ebe81974e38abb52579', 'request_id': 'req-acdc555f-137a-47f1-8d15-b19e8a3811a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.859963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:10.893473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] The token cache is being invalidate because project 7022f64a09064ebe81974e38abb52579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:10.893766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.894440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-acdc555f-137a-47f1-8d15-b19e8a3811a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:10.904014 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1019/2026] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:10 2022] DELETE /identity/v3/projects/7022f64a09064ebe81974e38abb52579 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:10.907692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:10.907978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:10.908243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:10.924805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:10.928204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:10.929227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:11.004731 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1008/2027] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:11.012497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.012785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.013056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.033631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:11.034884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:11.042965 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1020/2028] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:11.047223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.058468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff45c0-c54f-4274-8217-3b93113007e7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.063913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.064539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.064808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.065084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.065732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:11.066069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.067668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.079686 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1009/2029] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:11.084050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.093407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf7f0-9465-4f8d-bf62-771a8b387c46 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.098879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.099580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.106555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.106555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.106555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.106555 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.214452 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1021/2030] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:11.218300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.228539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a019ed-081d-46b3-b3ba-88130b84cf31 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.289410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.290084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.290365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.290806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.291576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.293697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.394213 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1010/2031] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:11.395791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.406075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769dd9-e9b5-4110-bff4-ab0760abaa13 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.412347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.412957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.413238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.413511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.414201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.415852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.426064 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1022/2032] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:11.430197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.440938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63998b29-9730-431d-926e-eaf95088758c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.445673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.446388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.446675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.446957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.447605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.449206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73debba-b7fa-46ab-822f-ed84e35f0323 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.461315 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1011/2033] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:11.465452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.478079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78cc9-08c1-4bcf-bf12-f2f9aca6763e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.483140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.483820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.484101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.484381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] PATH_INFO: `/v3/projects/99071ad7629647c2b4baffae7d6c1b89/users/b2a9c40fc2e546c5a2c270b29e531230/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.499515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99071ad7629647c2b4baffae7d6c1b89, user_id=b2a9c40fc2e546c5a2c270b29e531230, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.502354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.574105 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1023/2034] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:11 2022] PUT /identity/v3/projects/99071ad7629647c2b4baffae7d6c1b89/users/b2a9c40fc2e546c5a2c270b29e531230/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:11.585823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.586151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.586434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.614494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] MFA Rules not processed for user `b2a9c40fc2e546c5a2c270b29e531230`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:11.615718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:11.682881 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1012/2035] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:11.689781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.749516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7847d9-9aaf-4c61-adb5-09fd4577b028 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.754931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.755550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.755830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.756105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.756730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.758656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:11.890043 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1024/2036] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:11.894494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:11.905016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181555fe-d704-4959-a9f7-ff6dfe181e34 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:11.961256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:11.961794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:11.962140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:11.962427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:11.963069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:11.965031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.043518 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1013/2037] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:11 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:12.048433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:12.066093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc69f-9da1-4509-86d5-5b8a6f57ec3b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:12.070941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:12.071579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.071866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.072146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.072817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:12.074467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.086006 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1025/2038] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:12.090440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:12.101432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9069-867a-4220-b3f9-eb629f7c1fdd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:12.106181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:12.106918 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.107233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.107522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] PATH_INFO: `/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b/users/bfaef836b7274bcf96f4af8bbe46ba8b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.124430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24973b3cc2a4849bc1b68cd8bf3d97b, user_id=bfaef836b7274bcf96f4af8bbe46ba8b, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:12.127748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.225853 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1014/2039] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:12 2022] PUT /identity/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b/users/bfaef836b7274bcf96f4af8bbe46ba8b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:12.229604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:12.242906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d54fc-1f3f-4a79-b5a3-a601f6cd542a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:12.254707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:12.326759 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:12.327397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.327677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.327952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.328620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:12.332432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dd414-3e70-4623-84f1-61ed981e0802 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.353104 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1026/2040] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:12.360960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:12.365358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f071d9-ad7c-4de7-aa84-b846b62d39cc admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:12.370496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:12.371883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.372315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.372764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] PATH_INFO: `/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b/users/bfaef836b7274bcf96f4af8bbe46ba8b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.375503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24973b3cc2a4849bc1b68cd8bf3d97b, user_id=bfaef836b7274bcf96f4af8bbe46ba8b, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:12.378814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.389936 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1015/2041] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:12 2022] PUT /identity/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b/users/bfaef836b7274bcf96f4af8bbe46ba8b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:12.395694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:12.401926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.406146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.406146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.436599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] MFA Rules not processed for user `bfaef836b7274bcf96f4af8bbe46ba8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:12.437474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:12.527441 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1027/2042] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:12.541172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:12.543292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:12.607615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b89603-0f64-498a-a8a1-fc6ba06e8a10 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:12.611730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:12.612360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:12.612702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:12.612981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:12.622259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:12.623695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:12.633748 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1016/2043] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:13.362692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:14.258219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:14.268068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e0d2e-41ad-488e-afda-8face738bbaf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:14.272644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaef836b7274bcf96f4af8bbe46ba8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:14.273240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:14.273526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:14.273806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:14.274481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:14.274819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:14.276418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:14.287689 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1028/2044] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:14.291654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:14.301741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b190ca8-a7bb-47f2-ac0d-4659b3703e23 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:14.306293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaef836b7274bcf96f4af8bbe46ba8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:14.312326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:14.312326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:14.312326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:14.312326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:14.312326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:14.478914 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1017/2045] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:14 2022] POST /identity/v3/projects => generated 355 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:14.482998 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:14.493375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebbda0-bbaa-4494-b5d4-e9147979c1ca tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:14.552963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaef836b7274bcf96f4af8bbe46ba8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:14.553610 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:14.553949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:14.554230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:14.554923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:14.555298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:14.556906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:14.569364 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1029/2046] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:14.608696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:14.619264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d32f88-76de-49ed-ab04-c3ee503331dc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:14.627872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaef836b7274bcf96f4af8bbe46ba8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:14.628742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:14.629062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:14.642597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] PATH_INFO: `/v3/projects/1be938a3fd9848909cca7aee3315a8f0` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:14.642597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1be938a3fd9848909cca7aee3315a8f0)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:14.642597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:14.790475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be938a3fd9848909cca7aee3315a8f0', 'request_id': 'req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:14.797454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be938a3fd9848909cca7aee3315a8f0', 'request_id': 'req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:14.805063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be938a3fd9848909cca7aee3315a8f0', 'request_id': 'req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:14.929509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] The token cache is being invalidate because project 1be938a3fd9848909cca7aee3315a8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:14.930058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:14.933993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a426f295-0a8c-4859-ad83-af1cbbc3d1b8 tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:14.939889 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1018/2047] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:14 2022] DELETE /identity/v3/projects/1be938a3fd9848909cca7aee3315a8f0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:14.984180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:15.855233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:15.944104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:15.949273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:16.056947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965da61-70de-4c6c-a8de-92749ee365bc tempest-VolumeQuotaClassesTest-212705950 tempest-VolumeQuotaClassesTest-212705950-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:16.135382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:16.136038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:16.136325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:16.136588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] PATH_INFO: `/v3/users/b2a9c40fc2e546c5a2c270b29e531230` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:16.137696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a9c40fc2e546c5a2c270b29e531230)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:16.140437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:16.390971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a9c40fc2e546c5a2c270b29e531230'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:16.464950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a9c40fc2e546c5a2c270b29e531230'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:16.473206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a9c40fc2e546c5a2c270b29e531230'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:16.473919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a9c40fc2e546c5a2c270b29e531230'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:16.488234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a9c40fc2e546c5a2c270b29e531230'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:16.494822 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1030/2048] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:15 2022] DELETE /identity/v3/users/b2a9c40fc2e546c5a2c270b29e531230 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:16.499362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:16.499655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:16.499986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:16.520260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:16.521484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:16.585231 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1019/2049] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:16.595156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:16.597008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:16.655938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2733fc-6c4d-4ec7-a305-f9c6c53038d2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:16.660463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:16.661064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:16.661367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:16.661629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:16.670600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:16.672032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:16.682013 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1031/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:17.064564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:17.228360 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:17.229965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:17.242361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf35ba-df58-406e-b091-caf113e1eadf None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:17.248280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:17.249041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:17.249209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:17.249488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] PATH_INFO: `/v3/projects/99071ad7629647c2b4baffae7d6c1b89` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:17.251228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=99071ad7629647c2b4baffae7d6c1b89)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:17.253238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:17.385340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99071ad7629647c2b4baffae7d6c1b89', 'request_id': 'req-2a5da03e-9961-4cdb-bc09-3994de7639dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:17.391335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99071ad7629647c2b4baffae7d6c1b89', 'request_id': 'req-2a5da03e-9961-4cdb-bc09-3994de7639dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:17.398273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99071ad7629647c2b4baffae7d6c1b89', 'request_id': 'req-2a5da03e-9961-4cdb-bc09-3994de7639dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:17.440653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:17.482088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] The token cache is being invalidate because project 99071ad7629647c2b4baffae7d6c1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:17.482395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:17.483026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:17.484574 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1020/2051] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:17 2022] DELETE /identity/v3/projects/99071ad7629647c2b4baffae7d6c1b89 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:17.489265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:17.498950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a55d-d5c3-439b-be23-85a49554a915 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:17.555398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:17.556019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:17.556299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:17.556574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] PATH_INFO: `/v3/users/bfaef836b7274bcf96f4af8bbe46ba8b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:17.557695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfaef836b7274bcf96f4af8bbe46ba8b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:17.559643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:17.900223 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfaef836b7274bcf96f4af8bbe46ba8b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.011569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfaef836b7274bcf96f4af8bbe46ba8b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.019770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfaef836b7274bcf96f4af8bbe46ba8b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.020487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfaef836b7274bcf96f4af8bbe46ba8b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.034161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-351d835d-7200-4676-b4ef-10977fe602a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfaef836b7274bcf96f4af8bbe46ba8b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.040413 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1032/2052] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:17 2022] DELETE /identity/v3/users/bfaef836b7274bcf96f4af8bbe46ba8b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:18.517478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:18.517478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:18.526900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5da03e-9961-4cdb-bc09-3994de7639dd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:18.589020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:18.589721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:18.590048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:18.596715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] PATH_INFO: `/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:18.596715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24973b3cc2a4849bc1b68cd8bf3d97b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:18.596715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:18.764996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'request_id': 'req-d149cf21-6cf9-4766-ac75-5e19266d2cbd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.771228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'request_id': 'req-d149cf21-6cf9-4766-ac75-5e19266d2cbd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.777657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24973b3cc2a4849bc1b68cd8bf3d97b', 'request_id': 'req-d149cf21-6cf9-4766-ac75-5e19266d2cbd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.857185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:18.902887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] The token cache is being invalidate because project a24973b3cc2a4849bc1b68cd8bf3d97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:18.903185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.903824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d149cf21-6cf9-4766-ac75-5e19266d2cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:18.905315 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1021/2053] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:18 2022] DELETE /identity/v3/projects/a24973b3cc2a4849bc1b68cd8bf3d97b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:18.911121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:18.911408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:18.911685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:18.932079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:18.933267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:18.992662 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1033/2054] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:19.000366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.001237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.001514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.021084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:19.022375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:19.030421 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1022/2055] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:19.046276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.056481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830b4b6-1367-4aeb-95dd-0e6a51fd563b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.061082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.061676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.061996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.062273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.063633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:19.063948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.065578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.077159 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1034/2056] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:19.081746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.090820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5abab-e955-48d1-9a56-10735a2ffba7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.096492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.096636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.096920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.097196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.097847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.099779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.201514 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1023/2057] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:19.202890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.213005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd08d-a002-4164-a9fe-0f7a256b7101 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.302942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.303803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.304232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.304449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.305103 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.307133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.413128 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1035/2058] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:19.418777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.437217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd179357-e72c-4677-bc21-bd16491a9a87 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.451571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.452251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.452536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.452809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.453548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.455585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.470297 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1024/2059] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:19.471559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.481974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094edc1-1dc8-411b-9d01-da5d393eb905 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.487636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.488247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.488528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.488895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.490084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.491800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391028c-6565-43ea-948f-ed5c3e5db016 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.503148 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1036/2060] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:19.507570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.510482 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:19.520702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cfdb3-fc8c-4750-9132-d31cdf72703a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.525921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.526625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.527212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.527212 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] PATH_INFO: `/v3/projects/b9bf826bb6324dc39b3f14f5138cd586/users/e61b7797d0274d8b8dbcd18edb3f8abc/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.542955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bf826bb6324dc39b3f14f5138cd586, user_id=e61b7797d0274d8b8dbcd18edb3f8abc, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.545638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.623226 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1025/2061] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:19 2022] PUT /identity/v3/projects/b9bf826bb6324dc39b3f14f5138cd586/users/e61b7797d0274d8b8dbcd18edb3f8abc/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:19.635142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.635434 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.635710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.670792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:19.677391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] MFA Rules not processed for user `e61b7797d0274d8b8dbcd18edb3f8abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:19.678848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:19.745635 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1037/2062] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:19.750654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.814599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605632-1546-4f98-a2e4-128384e9f0e5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:19.819353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:19.819961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.820244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.820525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.821150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:19.823129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf83949-24d4-42ee-b699-98047a05bd3d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:19.951036 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1026/2063] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:19.956878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:19.970461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:19.971138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:19.971138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:19.975027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36af60-225c-4926-92ac-b921dabbfec6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.004829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:20.006946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:20.076453 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1027/2064] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:20.085123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.085796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.090299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.092091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.092611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.095371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.139999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.142742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:20.203938 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1038/2065] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:19 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:20.205795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.218803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b70c-3be2-47f3-9064-5a0edcb2919e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.224956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.225570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.225907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.226204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.226858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.228473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.237094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de39a-dee7-4eca-be67-f4d84b9b06a6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.240337 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1039/2066] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:20.244231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.244612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.245232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.245522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.245791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.254965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.256579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.260670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e55fc3-8990-4bcc-b21d-104dcd584602 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.265224 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1028/2067] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:18:20.272970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.273629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.273963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.274242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.274951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.279845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bd737-e419-443e-a738-3da3e717891c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.290662 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1040/2068] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:20.295120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.306859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0215d-338a-4ef5-ad93-b23a71fcfbcd service swift] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.311615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.315543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.315543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.315543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] PATH_INFO: `/v3/projects/67f7dd98a4ee4359a9449cb3ea21d4e0/users/0a0b1e5f9ec74387ac01229b4bbf3022/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.328083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f7dd98a4ee4359a9449cb3ea21d4e0, user_id=0a0b1e5f9ec74387ac01229b4bbf3022, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.331697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.437048 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1029/2069] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:20 2022] PUT /identity/v3/projects/67f7dd98a4ee4359a9449cb3ea21d4e0/users/0a0b1e5f9ec74387ac01229b4bbf3022/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:20.447536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.447771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.448097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.482293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] MFA Rules not processed for user `0a0b1e5f9ec74387ac01229b4bbf3022`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:20.483612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:20.589871 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1041/2070] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:20.593629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.665223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc97b9-e826-4b08-9671-8d0e52f66103 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.670060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.670695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.671025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.671314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.672007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.674269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:20.872334 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1030/2071] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:20 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:20.877286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:20.887777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc797cd-d8a3-4985-a6b6-c626562f32f8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:20.949064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:20.949699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:20.950009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:20.950287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:20.951176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:20.953158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.084665 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1042/2072] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:20 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:21.089213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.101038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9756-2095-4285-886a-f2ff4f2ae153 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.108292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.108914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.109202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.109502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.111179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.112994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.129786 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1031/2073] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:21.134101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.144965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456b8c-b990-42ee-ab4a-327b624b5325 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.150081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.150963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.151352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.151736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] PATH_INFO: `/v3/projects/8e68413e21854f26aecd40b5adc47cfd/users/89a7bba2500c44308965fa8754d1e723/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.169912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e68413e21854f26aecd40b5adc47cfd, user_id=89a7bba2500c44308965fa8754d1e723, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.174344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdc9ee-7511-483d-a3ab-f335a15ba62c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.315207 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1043/2074] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:21 2022] PUT /identity/v3/projects/8e68413e21854f26aecd40b5adc47cfd/users/89a7bba2500c44308965fa8754d1e723/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:21.319371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.333883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719682f-5ab9-4072-8554-15dbb370f3a6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.409306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:21.429227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.429856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.430204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.430449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.430549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.430914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.431120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.431489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.432749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.444545 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1032/2075] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:21.448607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.459095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded36d1c-0b76-4d55-a555-686a9ef77f27 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.460193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:21.461461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:21.463710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.464386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.464668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.464945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] PATH_INFO: `/v3/projects/8e68413e21854f26aecd40b5adc47cfd/users/89a7bba2500c44308965fa8754d1e723/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.467004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e68413e21854f26aecd40b5adc47cfd, user_id=89a7bba2500c44308965fa8754d1e723, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.470814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d078b6-d2c3-43bc-b6f0-27ffd6889aa4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.481403 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1033/2076] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:21 2022] PUT /identity/v3/projects/8e68413e21854f26aecd40b5adc47cfd/users/89a7bba2500c44308965fa8754d1e723/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:21.492401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.492777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.493060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.524013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] MFA Rules not processed for user `89a7bba2500c44308965fa8754d1e723`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:21.525548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:21.535640 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1044/2077] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:21.550011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.564464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:21.609036 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1034/2078] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:21.620387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:21.621741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:21.630159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81187c6-d86d-41f8-b3e5-9e47c3892617 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.683201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9611f9c-47ed-44b9-8929-e2b7292bc70f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:21.687334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.688000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.688293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.688575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.691246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:21.691860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:21.692140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:21.692423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:21.699463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.701331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.713287 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1035/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:18:21.754010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:21.756366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172d7af-f80a-4b21-b4aa-abe0b3fedc0a service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:21.771998 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1045/2080] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:18:21.933907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:21.991064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:22.139280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:22.140582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:22.226231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c0e5-d494-461e-b63c-feebf6da597e service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:22.231190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:22.231940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:22.232226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:22.232942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] PATH_INFO: `/v3/users/e945b19378fb4e8fb981a9836d8b2950` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:22.234614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e945b19378fb4e8fb981a9836d8b2950)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:22.237617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:22.495523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e945b19378fb4e8fb981a9836d8b2950'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:22.505024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e945b19378fb4e8fb981a9836d8b2950'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:22.507376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:22.508248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:22.508248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:22.533161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:22.536243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:22.544677 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1046/2081] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:22.559856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:22.573589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd89bb-dae3-42db-afcd-a0517d9ccfcc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:22.579214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:22.580053 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:22.580489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:22.580911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:22.589391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e945b19378fb4e8fb981a9836d8b2950'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:22.590393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e945b19378fb4e8fb981a9836d8b2950'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:22.598690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:22.606943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:22.609375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:22.610478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b87d451d-baf3-4fce-845e-22b1e31ed976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e945b19378fb4e8fb981a9836d8b2950'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:22.619943 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1036/2082] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:22 2022] DELETE /identity/v3/users/e945b19378fb4e8fb981a9836d8b2950 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:22.621048 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1047/2083] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:22.624861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:22.625770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:22.626302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:22.645976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:22.647255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:22.712280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1037/2084] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:22.747908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:22.749367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:22.809941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa91f-77cb-48f4-8968-c2f224dd8c48 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:22.867314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:22.868250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:22.868565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:22.874257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:22.885154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:22.886740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b642-4de6-4478-8043-25508dd830d3 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:22.898832 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1048/2085] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:22.956934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:23.060307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:23.061976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:23.131563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe17c5d-9412-45be-9b64-63befacc0e61 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:23.135856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:23.136530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:23.136879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:23.137214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:23.139183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:23.202934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:23.204457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:23.214502 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1038/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:23.389353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:23.389702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:23.390194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:23.414431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:23.415923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:23.478106 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1049/2087] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:23.494035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:23.496591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:23.573209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435381-255f-4621-b84a-2d109e743ce4 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:23.579138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:23.579867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:23.580159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:23.580437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:23.588603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:23.590306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f0e83-e84f-45c0-a2d6-4bdab72a235d service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:23.599018 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1039/2088] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:23.672132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:23.673810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:23.693317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b560726-e04c-470f-bc0b-c83963265824 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:23.704757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:23.705613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:23.705923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:23.706204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] PATH_INFO: `/v3/projects/c58847206e884cf9a2e50f2cd26801d8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:23.707449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58847206e884cf9a2e50f2cd26801d8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:23.709413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:23.870765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58847206e884cf9a2e50f2cd26801d8', 'request_id': 'req-047b610c-615a-4af6-b535-03bd113de412'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:23.892879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58847206e884cf9a2e50f2cd26801d8', 'request_id': 'req-047b610c-615a-4af6-b535-03bd113de412'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:23.892879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58847206e884cf9a2e50f2cd26801d8', 'request_id': 'req-047b610c-615a-4af6-b535-03bd113de412'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:24.007282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] The token cache is being invalidate because project c58847206e884cf9a2e50f2cd26801d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:24.007487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:24.008156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-047b610c-615a-4af6-b535-03bd113de412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:24.010101 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1050/2089] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:23 2022] DELETE /identity/v3/projects/c58847206e884cf9a2e50f2cd26801d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:24.016931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.017440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.018027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.039835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:24.040980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:24.113052 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1040/2090] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:24.114549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.114841 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.115125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.148000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:24.149256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:24.159525 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1051/2091] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:24.163481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.174116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:24.179945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fea7a-f8c3-4e7f-9c11-f38862640218 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.192705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.193496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.193775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.194178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.195425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:24.196050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.198734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.213413 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1041/2092] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:24.216357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.225826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7209-457e-45d2-9d36-2f81d9625bc5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.230954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.231557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.231843 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.232115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.232872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.235410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.369411 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1052/2093] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:24.377052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.397254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fbae-cb8e-42b4-89b2-b5c89b996d3a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.460479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.461101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.461388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.461674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.462344 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.464604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.508957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:24.578961 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1042/2094] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:24 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:18:24.580772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.597422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df342fc-3d46-45a7-9520-c32ddac882df admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.603227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.604148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.604664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.605080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.606138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.607925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.619483 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1053/2095] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:24.629967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.647728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d39177-d92a-4f52-a733-ca2b6fb7e7d9 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.653283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.653945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.654235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.654527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.655204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.657170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e5553-132b-4e6f-9731-a1e54aa7eba9 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.671870 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1043/2096] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:24.676268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:24.686784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89e14-883f-4fe7-ba87-e0c5f3134a13 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:24.692485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:24.693164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.693500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.693744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] PATH_INFO: `/v3/projects/4de628a664a84c279bfdaa7105972fd4/users/cb1bbc1683f24a5aa356438e533e1fb1/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.711881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de628a664a84c279bfdaa7105972fd4, user_id=cb1bbc1683f24a5aa356438e533e1fb1, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:24.715073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:24.925336 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1054/2097] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:24 2022] PUT /identity/v3/projects/4de628a664a84c279bfdaa7105972fd4/users/cb1bbc1683f24a5aa356438e533e1fb1/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:24.930513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:24.930825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:24.931113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:24.964790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:24.966101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:25.069000 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1044/2098] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:25.080225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:25.082134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:25.168146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de18f2-9d83-4f8d-af1c-226742916e7c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:25.173447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:25.174087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:25.174380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:25.178890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:25.190508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:25.192157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:25.222378 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1055/2099] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:26.840137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:27.236691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:27.238217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:27.250756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22143a4-deb7-4c0c-96b8-dc8cb284632a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:27.255859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:27.256503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:27.256784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:27.257058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] PATH_INFO: `/v3/users/264ff114924043cb81e271513628e0dd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:27.258225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264ff114924043cb81e271513628e0dd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:27.260698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:27.539955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:27.541431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:27.555233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b8b53-f3c6-4272-8dd3-70821f77f06e service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:27.566935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:27.567356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:27.567792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:27.568067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] PATH_INFO: `/v3/users/f270593db29b4835952de74f591011c5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:27.569256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f270593db29b4835952de74f591011c5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:27.571275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:27.636997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:27.695603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264ff114924043cb81e271513628e0dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.703059 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264ff114924043cb81e271513628e0dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.832302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f270593db29b4835952de74f591011c5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.882125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264ff114924043cb81e271513628e0dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.883138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264ff114924043cb81e271513628e0dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.897417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-32838cda-002d-476d-891a-fbb3ce071e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264ff114924043cb81e271513628e0dd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:27.903624 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1045/2100] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:27 2022] DELETE /identity/v3/users/264ff114924043cb81e271513628e0dd => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:27.908683 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:27.908995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:27.909248 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:27.946266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:27.947125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:27.995524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f270593db29b4835952de74f591011c5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.007281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f270593db29b4835952de74f591011c5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.008029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f270593db29b4835952de74f591011c5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.024367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f270593db29b4835952de74f591011c5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.034081 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1056/2101] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:27 2022] DELETE /identity/v3/users/f270593db29b4835952de74f591011c5 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:28.040871 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1046/2102] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:28.048395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:28.051630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:28.126354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62a06f-33fe-4033-a85e-65ae5b6994fd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:28.130334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:28.131005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:28.131284 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:28.132150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:28.203806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:28.205435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:28.227670 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1057/2103] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:18:28.492435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:28.494905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:28.539315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1c5e-9b29-430e-bb47-09ddec33cfcf None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:28.557032 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:28.559023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:28.559885 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:28.561579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] PATH_INFO: `/v3/projects/90a4367254cc4a318f7abe3a16821bf8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:28.563721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a4367254cc4a318f7abe3a16821bf8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:28.567349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:28.653030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:28.660326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:28.688473 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa59e-8635-4f1c-8548-b6a32747a5fc service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:28.694749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:28.695757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:28.696627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:28.697264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] PATH_INFO: `/v3/projects/58a87d95208a488dac6a1559462c6445` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:28.699220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a87d95208a488dac6a1559462c6445)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:28.704624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:28.782525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a4367254cc4a318f7abe3a16821bf8', 'request_id': 'req-c162bb66-0202-48db-854a-55e3cac9c2c7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.789305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a4367254cc4a318f7abe3a16821bf8', 'request_id': 'req-c162bb66-0202-48db-854a-55e3cac9c2c7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.797254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a4367254cc4a318f7abe3a16821bf8', 'request_id': 'req-c162bb66-0202-48db-854a-55e3cac9c2c7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.912395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] The token cache is being invalidate because project 90a4367254cc4a318f7abe3a16821bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:28.915394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.915394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c162bb66-0202-48db-854a-55e3cac9c2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.915394 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1047/2104] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:28 2022] DELETE /identity/v3/projects/90a4367254cc4a318f7abe3a16821bf8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:28.920202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd1ed-e9d4-4aa7-898f-0b35fb21b769 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:28.920490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd1ed-e9d4-4aa7-898f-0b35fb21b769 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:28.920764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfd1ed-e9d4-4aa7-898f-0b35fb21b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:28.925460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a87d95208a488dac6a1559462c6445', 'request_id': 'req-c2e0c902-7a17-4df6-aeeb-3ef185f97351'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.930928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a87d95208a488dac6a1559462c6445', 'request_id': 'req-c2e0c902-7a17-4df6-aeeb-3ef185f97351'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.938300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a87d95208a488dac6a1559462c6445', 'request_id': 'req-c2e0c902-7a17-4df6-aeeb-3ef185f97351'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:28.940317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cbbfd1ed-e9d4-4aa7-898f-0b35fb21b769 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:28.941517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cbbfd1ed-e9d4-4aa7-898f-0b35fb21b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.002262 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1048/2105] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:29.009903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.010400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.010604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.040002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:29.041227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.042846 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] The token cache is being invalidate because project 58a87d95208a488dac6a1559462c6445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:29.043388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:29.048433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e0c902-7a17-4df6-aeeb-3ef185f97351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:29.050203 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1058/2106] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:28 2022] DELETE /identity/v3/projects/58a87d95208a488dac6a1559462c6445 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:29.055987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b88bc-7908-4177-a7c6-f6a91ab13a7c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.056544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b88bc-7908-4177-a7c6-f6a91ab13a7c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.057026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b88bc-7908-4177-a7c6-f6a91ab13a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.059107 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1049/2107] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:29.066229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.078529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84690d5f-d7f4-40aa-a4b5-d1d8adbe4ad0 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.085163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.088426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.089039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.089039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.089651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:29.090079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.105708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.106299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c63b88bc-7908-4177-a7c6-f6a91ab13a7c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:29.108082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c63b88bc-7908-4177-a7c6-f6a91ab13a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.122454 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1059/2108] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:29.129441 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1050/2109] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:29.131565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.132057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.132639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.134124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.147101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe26a1-384d-451d-869e-b0e627ef38e3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.152511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.153459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.155639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.155639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.155639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.158038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.169425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:29.170693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.189465 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1060/2110] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:29.193174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.204401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deeacd-abe1-4233-9707-d9773554b4d5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.209465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.210433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.210815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.211262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.212020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:29.212424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.214274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.232502 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1061/2111] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:18:29.243592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.257593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694e7f-3138-4dc2-aec4-dda57d6f2ca0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.262864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.263589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.263974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.264351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.265077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.272520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.277081 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1051/2112] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:29.283936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.374471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae5f6-10cf-4b63-bb8a-9c451d548eda admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.381059 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1062/2113] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:18:29.384798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.385524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.385888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.386330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.386920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.388788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.392401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.494120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f39d0-6e79-4fa1-b67a-e6dc01c6896f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.512804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.512804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.512804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.512804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.513179 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.513596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.537533 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1052/2114] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:29.537533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.537533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.612961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697861b5-7024-4293-b2cf-4b8ae8a779f7 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.678440 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.679415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.680091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.680382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.683747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:29.716681 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1063/2115] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:29 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:18:29.721111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.740387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ab14-f3de-4f2a-b783-a123a75cb4ce admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.751736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.752525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.753292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.753573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.754273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.755924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.778740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.780274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.789111 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1064/2116] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:29.790355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.798378 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1053/2117] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:29.801397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.814439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d976-34d0-4ffa-8106-1de5c8fec94d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.820895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b87c7-1f3f-4566-a247-46b5678ae8ad service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.832819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.833456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.833738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.834160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.834834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.835220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.835847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.836276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.836556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.836666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.837208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.838834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.849092 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1054/2118] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:29.853338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.860739 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1065/2119] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:29.864876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.871266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3677c-59e0-4e29-8869-ed04d2ed0b18 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.877669 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.878893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.879270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1548-ce83-4093-a1c1-a82452c78878 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.879393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.880455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] PATH_INFO: `/v3/projects/32cc230c70b341fca95fa1b962d73909/users/75266a74abbb4129bac206a7d5944466/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.885014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.885014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.885289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.885491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.886696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.888388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.903344 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1066/2120] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:29.903530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cc230c70b341fca95fa1b962d73909, user_id=75266a74abbb4129bac206a7d5944466, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.904388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:29.904597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb158b-192e-4287-a0b6-ed309dfa49aa admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:29.914897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2b71e-adb4-4a0c-812b-0aa3c93d13eb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:29.919777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:29.920423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:29.920703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:29.920975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] PATH_INFO: `/v3/projects/a6fc30dcc0174076bf3b10ca2cf259d3/users/ce213a10665d469c9fa08e29db751eb5/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:29.936312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fc30dcc0174076bf3b10ca2cf259d3, user_id=ce213a10665d469c9fa08e29db751eb5, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:29.939250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86877692-61ef-4483-8e7c-df4ef9a6b7a5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:30.036042 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1055/2121] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:29 2022] PUT /identity/v3/projects/32cc230c70b341fca95fa1b962d73909/users/75266a74abbb4129bac206a7d5944466/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:30.040276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:30.040711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:30.041109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:30.063074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:30.064311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:30.113528 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1067/2122] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:29 2022] PUT /identity/v3/projects/a6fc30dcc0174076bf3b10ca2cf259d3/users/ce213a10665d469c9fa08e29db751eb5/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:30.124247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:30.124543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:30.125093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:30.146830 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1056/2123] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:30.161284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:30.200823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:30.201007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] MFA Rules not processed for user `ce213a10665d469c9fa08e29db751eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:30.201007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:30.243223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797182c-98d2-4e30-96fe-7da9d781f124 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:30.295410 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1068/2124] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:30.303628 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:30.305147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:30.308680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:30.309295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:30.309586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:30.309948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:30.367643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0e944-3333-4dfa-9218-52faeee806ac None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:30.371587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:30.372201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:30.372535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:30.372820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:30.380599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:30.382094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:30.383241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:30.384706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:30.393078 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1057/2125] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:30.395583 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1069/2126] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:18:30.517545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:30.870529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:31.568533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:31.580316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe95a-2865-4064-bb57-149d7a8c4f9a service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:31.584832 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:31.585572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:31.586159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:31.586525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:31.594836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:31.677000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:31.678634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458deb2-9943-4609-a5b4-c7da7a9de76d service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:31.688959 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1058/2127] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:31.930488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:31.932685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:31.962877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d0a9-1394-434e-be26-aca90c76e915 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:31.974665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:31.980504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:31.980504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:31.980504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] PATH_INFO: `/v3/users/36f1155ddd0045beb4bc0d9cc9084b12` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:31.980504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f1155ddd0045beb4bc0d9cc9084b12)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:31.985238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:32.384595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f1155ddd0045beb4bc0d9cc9084b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:32.488294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f1155ddd0045beb4bc0d9cc9084b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:32.502432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f1155ddd0045beb4bc0d9cc9084b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:32.503475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f1155ddd0045beb4bc0d9cc9084b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:32.528413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f1155ddd0045beb4bc0d9cc9084b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:32.552008 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1070/2128] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:31 2022] DELETE /identity/v3/users/36f1155ddd0045beb4bc0d9cc9084b12 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:32.552202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4813-806d-429c-b718-fd34a9fa4278 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:32.552202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4813-806d-429c-b718-fd34a9fa4278 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:32.552202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4813-806d-429c-b718-fd34a9fa4278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:32.575084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9acf4813-806d-429c-b718-fd34a9fa4278 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:32.577404 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9acf4813-806d-429c-b718-fd34a9fa4278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:32.670437 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1059/2129] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:32.680649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:32.682710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:32.750914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8dea8-3235-45c5-8eba-ded26d2fa82d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:32.754953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:32.755567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:32.755851 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:32.756127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:32.767119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:32.768644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:32.779590 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1071/2130] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:33.496254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296df3-8961-4842-927b-df802edaa505 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.496254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296df3-8961-4842-927b-df802edaa505 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.496499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296df3-8961-4842-927b-df802edaa505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.533549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-77296df3-8961-4842-927b-df802edaa505 None None] MFA Rules not processed for user `cb1bbc1683f24a5aa356438e533e1fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:33.534808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-77296df3-8961-4842-927b-df802edaa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:33.575457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:33.576934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:33.594926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fac54-3bfa-4532-a196-b4addc832229 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:33.603514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:33.604156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.604719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.605327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] PATH_INFO: `/v3/projects/cf34c97172ed4eb7998b79636e604d72` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.607490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf34c97172ed4eb7998b79636e604d72)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:33.609634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:33.619419 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1060/2131] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:33.620553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296df3-8961-4842-927b-df802edaa505 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:33.622370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-77296df3-8961-4842-927b-df802edaa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:33.643436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296df3-8961-4842-927b-df802edaa505 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:33.649817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:33.650850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.651429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.651919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.652791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:33.655020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:33.783459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf34c97172ed4eb7998b79636e604d72', 'request_id': 'req-3abf5325-e1d7-4f0e-8212-285e57621615'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:33.797373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf34c97172ed4eb7998b79636e604d72', 'request_id': 'req-3abf5325-e1d7-4f0e-8212-285e57621615'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:33.805312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf34c97172ed4eb7998b79636e604d72', 'request_id': 'req-3abf5325-e1d7-4f0e-8212-285e57621615'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:33.866616 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1061/2132] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:33 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:33.873907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:33.907922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] The token cache is being invalidate because project cf34c97172ed4eb7998b79636e604d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:33.908437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:33.911253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3abf5325-e1d7-4f0e-8212-285e57621615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:33.912030 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1072/2133] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:33 2022] DELETE /identity/v3/projects/cf34c97172ed4eb7998b79636e604d72 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:33.915950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a74b-6b79-45bb-a044-3eb61a1fea6f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.916238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a74b-6b79-45bb-a044-3eb61a1fea6f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.916516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a74b-6b79-45bb-a044-3eb61a1fea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.940454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8744a74b-6b79-45bb-a044-3eb61a1fea6f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:33.941699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8744a74b-6b79-45bb-a044-3eb61a1fea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:33.971385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514a3b9-31bc-4656-80fb-b0b00246efe6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:33.976781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:33.977396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.977681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.978006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.978670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:33.980668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.041528 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1073/2134] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:34.043074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.043414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.043689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.084913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:34.086572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:34.108933 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1074/2135] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:34.113065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.130249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d0f9-ccf0-4ebf-b39f-baeaa16d58ff None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.135265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.135887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.136171 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.136444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.137105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:34.137409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.139251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.150866 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1062/2136] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:33 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:34.154848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.158588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:34.164362 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1075/2137] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:18:34.169508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.174788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aed21-9c83-4e99-b6af-f95f5d2af282 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.191563 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:34.195777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.197501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.197792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.199414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.201094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.203097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4a30f-a087-4a34-bcba-18882789a93a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.206725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.208642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.209339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.209620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.209923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.210568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.213767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.229869 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1063/2138] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:34.234055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.245770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc10c92-0b40-41bd-bc13-0dc93c2927b2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.253017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.253881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.254283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.254634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] PATH_INFO: `/v3/projects/1927ddf53e5b40b4b4832a540d010eb1/users/3477ec9af9274781ac4168c75f923458/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.284473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927ddf53e5b40b4b4832a540d010eb1, user_id=3477ec9af9274781ac4168c75f923458, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.289597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.344618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:34.362453 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1076/2139] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:34 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:34.365675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.442817 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1064/2140] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:34 2022] PUT /identity/v3/projects/1927ddf53e5b40b4b4832a540d010eb1/users/3477ec9af9274781ac4168c75f923458/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:34.443963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.471796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314577-6803-41a9-8bb3-594223c81106 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.555044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.555788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.556083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.556369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.557010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.559136 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.614948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa643a8-6019-45e7-827e-cd9b8850dfb6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.641597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.642621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.643079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.643355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.644428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.646640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.659570 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1065/2141] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:34.664991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.690274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92345-5734-4dc7-b74a-65e47afb8bf3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.698372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.699470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.699916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.700692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] PATH_INFO: `/v3/projects/1927ddf53e5b40b4b4832a540d010eb1/users/3477ec9af9274781ac4168c75f923458/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.702208 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1077/2142] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:34 2022] POST /identity/v3/users => generated 282 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:18:34.704001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927ddf53e5b40b4b4832a540d010eb1, user_id=3477ec9af9274781ac4168c75f923458, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.707074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.732015 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1066/2143] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:34 2022] PUT /identity/v3/projects/1927ddf53e5b40b4b4832a540d010eb1/users/3477ec9af9274781ac4168c75f923458/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:34.739857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.769676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1632-7034-45e9-9d51-431c0b6ca0dd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:34.925599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:34.927178 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:34.927540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:34.928886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:34.929674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:34.934789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:34.953686 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1078/2144] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:34.957023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:34.987472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04fe0-f33c-4354-a1db-1a0baad4a4ae admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:35.004821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:35.004821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.004821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.004821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.005213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:35.005213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9490d9-cdd2-4a52-ac66-47e69da1b144 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:35.040631 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1067/2145] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:35.046764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:35.076066 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964e2b-de28-41df-a745-6dbfdd9ad0b4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:35.087334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:35.091080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.091080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.091441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] PATH_INFO: `/v3/projects/a81df2d157094b4bbb0507c5da446ffb/users/c338586d8b8244bd87d8234c5e11cf03/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.135965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81df2d157094b4bbb0507c5da446ffb, user_id=c338586d8b8244bd87d8234c5e11cf03, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:35.139581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:35.303943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.304442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.304829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.304944 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1079/2146] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:35 2022] PUT /identity/v3/projects/a81df2d157094b4bbb0507c5da446ffb/users/c338586d8b8244bd87d8234c5e11cf03/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:35.391309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] MFA Rules not processed for user `c338586d8b8244bd87d8234c5e11cf03`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:35.394949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:35.541764 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1068/2147] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:35.542999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:35.544956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:35.659094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6ced-fe4b-43ef-9029-53dfe0a5c2e2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:35.674920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:35.681006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.681006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.681006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.704602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:35.706850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c069578-9193-4c60-b07d-1240b100ffe0 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:35.719416 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1080/2148] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:36.900011 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:37.065002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:37.406546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:37.409588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:37.515428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb055bb-4ff8-40db-8b29-abe310b851d0 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:37.521020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:37.521954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:37.522424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:37.523041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] PATH_INFO: `/v3/users/e61b7797d0274d8b8dbcd18edb3f8abc` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:37.524717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61b7797d0274d8b8dbcd18edb3f8abc)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:37.526762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:37.843997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61b7797d0274d8b8dbcd18edb3f8abc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:37.856682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61b7797d0274d8b8dbcd18edb3f8abc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:37.956149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61b7797d0274d8b8dbcd18edb3f8abc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:37.957536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61b7797d0274d8b8dbcd18edb3f8abc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:37.990276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61b7797d0274d8b8dbcd18edb3f8abc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:38.024166 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1069/2149] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:37 2022] DELETE /identity/v3/users/e61b7797d0274d8b8dbcd18edb3f8abc => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:38.028734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:38.029902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:38.030269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:38.053420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:38.054705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:38.207784 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1081/2150] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:38.231037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:38.235914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:38.310767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829929-a3ff-4b0b-b35e-c9db7aa11883 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:38.314919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:38.315629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:38.318065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:38.318065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:38.329152 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:38.330681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:38.359912 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1070/2151] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:18:38.996253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:39.008512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:39.049396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14c0d8-a11f-4b0d-b16f-a7efc671e161 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:39.074084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:39.075339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:39.075773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:39.076196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] PATH_INFO: `/v3/projects/b9bf826bb6324dc39b3f14f5138cd586` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:39.079475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bf826bb6324dc39b3f14f5138cd586)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:39.082396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:39.284255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bf826bb6324dc39b3f14f5138cd586', 'request_id': 'req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:39.302654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bf826bb6324dc39b3f14f5138cd586', 'request_id': 'req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:39.328861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bf826bb6324dc39b3f14f5138cd586', 'request_id': 'req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:39.459080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] The token cache is being invalidate because project b9bf826bb6324dc39b3f14f5138cd586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:39.459379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:39.462252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43c0eb4e-dfb3-44c4-927b-649640ad7eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:39.464510 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1082/2152] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:38 2022] DELETE /identity/v3/projects/b9bf826bb6324dc39b3f14f5138cd586 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:39.469972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:39.483352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b3627-1671-405c-86ae-d672ba76dca7 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:39.579581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:39.581341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:39.583303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:39.584258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] PATH_INFO: `/v3/users/0a0b1e5f9ec74387ac01229b4bbf3022` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:39.586843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0b1e5f9ec74387ac01229b4bbf3022)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:39.589450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:39.902628 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da4b2-f6d2-4e09-8700-c02e07b85e4e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:39.903039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da4b2-f6d2-4e09-8700-c02e07b85e4e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:39.903422 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da4b2-f6d2-4e09-8700-c02e07b85e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:39.935961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fa6da4b2-f6d2-4e09-8700-c02e07b85e4e None None] MFA Rules not processed for user `75266a74abbb4129bac206a7d5944466`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:39.938286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fa6da4b2-f6d2-4e09-8700-c02e07b85e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:39.997819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0b1e5f9ec74387ac01229b4bbf3022'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:40.013025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0b1e5f9ec74387ac01229b4bbf3022'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:40.036562 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1083/2153] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:40.049194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:40.052811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:40.052811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:40.072012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] MFA Rules not processed for user `75266a74abbb4129bac206a7d5944466`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:40.073461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:40.082189 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1084/2154] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:40.095873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:40.098701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:40.110666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:40.111710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0b1e5f9ec74387ac01229b4bbf3022'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:40.112471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0b1e5f9ec74387ac01229b4bbf3022'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:40.140657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0b1e5f9ec74387ac01229b4bbf3022'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:40.157713 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1071/2155] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:39 2022] DELETE /identity/v3/users/0a0b1e5f9ec74387ac01229b4bbf3022 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:40.213023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbebfa6-c70e-4d45-ba57-ccf90b73b8c5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:40.298777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:40.390260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:40.394902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:40.394902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:40.394902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:40.394902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:40.473165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:40.486699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:40.515373 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1085/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:40.922795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:40.925031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:41.066377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485968-72a2-4fb0-9fb6-ead66d58379b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:41.071929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:41.072961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:41.072961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:41.073335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] PATH_INFO: `/v3/users/ce213a10665d469c9fa08e29db751eb5` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:41.074604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce213a10665d469c9fa08e29db751eb5)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:41.076968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:41.193097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:41.194761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:41.220220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd35c-7e5c-451d-b2bb-6560a2598414 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:41.234335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:41.240296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:41.240296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:41.240296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] PATH_INFO: `/v3/projects/67f7dd98a4ee4359a9449cb3ea21d4e0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:41.241731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f7dd98a4ee4359a9449cb3ea21d4e0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:41.242685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:41.401375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce213a10665d469c9fa08e29db751eb5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.420178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce213a10665d469c9fa08e29db751eb5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.468633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f7dd98a4ee4359a9449cb3ea21d4e0', 'request_id': 'req-fb0d175d-4e44-42e3-b493-4a70429f4812'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.478575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f7dd98a4ee4359a9449cb3ea21d4e0', 'request_id': 'req-fb0d175d-4e44-42e3-b493-4a70429f4812'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.490340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f7dd98a4ee4359a9449cb3ea21d4e0', 'request_id': 'req-fb0d175d-4e44-42e3-b493-4a70429f4812'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.585188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce213a10665d469c9fa08e29db751eb5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.586992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce213a10665d469c9fa08e29db751eb5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.614555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-27e27a92-be55-4b85-b50b-9c71c675b9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce213a10665d469c9fa08e29db751eb5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.626402 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1072/2157] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:40 2022] DELETE /identity/v3/users/ce213a10665d469c9fa08e29db751eb5 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:41.631586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:41.632091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:41.632512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:41.642440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:41.690825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:41.692082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:41.728771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] The token cache is being invalidate because project 67f7dd98a4ee4359a9449cb3ea21d4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:41.729616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.731998 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:41.736107 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1086/2158] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:41 2022] DELETE /identity/v3/projects/67f7dd98a4ee4359a9449cb3ea21d4e0 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:41.740481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:41.742205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:41.849823 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1073/2159] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:41.867167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:41.871669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d175d-4e44-42e3-b493-4a70429f4812 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:41.876069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:41.878796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:41.879712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:41.880111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:41.880508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] PATH_INFO: `/v3/users/89a7bba2500c44308965fa8754d1e723` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:41.881788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a7bba2500c44308965fa8754d1e723)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:41.884077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:42.021638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c6cb-ab55-4b65-ab49-3c75e864e382 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:42.029384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:42.034488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:42.034488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:42.034488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:42.055486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:42.059351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad49c-f57f-45f5-943b-9a8b3b995e85 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:42.089877 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1074/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:42.290373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:42.291054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:42.291411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:42.310249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a7bba2500c44308965fa8754d1e723'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:42.319940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] MFA Rules not processed for user `75266a74abbb4129bac206a7d5944466`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:42.321258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:42.456575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a7bba2500c44308965fa8754d1e723'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:42.457250 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1075/2161] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:42.466118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a7bba2500c44308965fa8754d1e723'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:42.468370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a7bba2500c44308965fa8754d1e723'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:42.494919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a7bba2500c44308965fa8754d1e723'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:42.502428 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1087/2162] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:41 2022] DELETE /identity/v3/users/89a7bba2500c44308965fa8754d1e723 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:43.090125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:43.094944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:43.113398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f89f1-6a75-4434-a301-7e9e9436b25c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:43.198945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:43.199596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:43.200166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:43.200438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] PATH_INFO: `/v3/projects/a6fc30dcc0174076bf3b10ca2cf259d3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.202365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fc30dcc0174076bf3b10ca2cf259d3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:43.204570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:43.405570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fc30dcc0174076bf3b10ca2cf259d3', 'request_id': 'req-df645872-a8a4-4f85-9864-275aa7cf7fdc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.415451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fc30dcc0174076bf3b10ca2cf259d3', 'request_id': 'req-df645872-a8a4-4f85-9864-275aa7cf7fdc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.425873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fc30dcc0174076bf3b10ca2cf259d3', 'request_id': 'req-df645872-a8a4-4f85-9864-275aa7cf7fdc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.481107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:43.484046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:43.525272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25460c9e-e2ad-437d-ab7f-bb0fd3ac453d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:43.540018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] The token cache is being invalidate because project a6fc30dcc0174076bf3b10ca2cf259d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:43.542226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.551798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df645872-a8a4-4f85-9864-275aa7cf7fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.555281 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1076/2163] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:43 2022] DELETE /identity/v3/projects/a6fc30dcc0174076bf3b10ca2cf259d3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:43.561041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0287-c933-40e4-b62d-480abbb7b637 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:43.561379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0287-c933-40e4-b62d-480abbb7b637 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:43.561666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0287-c933-40e4-b62d-480abbb7b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.611504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d03a0287-c933-40e4-b62d-480abbb7b637 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:43.612911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d03a0287-c933-40e4-b62d-480abbb7b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:43.659177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:43.659936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:43.660369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:43.661086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] PATH_INFO: `/v3/projects/8e68413e21854f26aecd40b5adc47cfd` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.662669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e68413e21854f26aecd40b5adc47cfd)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:43.677236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:43.737792 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1077/2164] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:43.746529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:43.747199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:43.747692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.774138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:43.775639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:43.786166 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1078/2165] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:43.791151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:43.801017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c13fb-c4be-4e2b-9623-9d3041211bf1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:43.806379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:43.807289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:43.807729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:43.808824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.809962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:43.817311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:43.817311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:43.843091 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1079/2166] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:18:43.849689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:43.877571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cb7f-9604-4f96-a331-1dd8d34cb09e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:43.900635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e68413e21854f26aecd40b5adc47cfd', 'request_id': 'req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.911902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:43.913001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e68413e21854f26aecd40b5adc47cfd', 'request_id': 'req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:43.927158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e68413e21854f26aecd40b5adc47cfd', 'request_id': 'req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:44.000030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.010118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.010118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.010118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.010118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.010118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.053627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] The token cache is being invalidate because project 8e68413e21854f26aecd40b5adc47cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:44.053954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:44.054690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9fe9bfd-4b02-4a35-8562-fe1605270ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:44.057992 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1088/2167] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:43 2022] DELETE /identity/v3/projects/8e68413e21854f26aecd40b5adc47cfd => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:44.064416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c431-5026-42d7-a9d5-79b4e23f1392 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.064712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c431-5026-42d7-a9d5-79b4e23f1392 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.065000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73c431-5026-42d7-a9d5-79b4e23f1392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.104461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2b73c431-5026-42d7-a9d5-79b4e23f1392 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:44.106056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2b73c431-5026-42d7-a9d5-79b4e23f1392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:44.124086 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1089/2168] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:44.134126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.134651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.135117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.167366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:44.169697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:44.180372 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1090/2169] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:44.186577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.196637 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1080/2170] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:43 2022] POST /identity/v3/projects => generated 383 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:44.200972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.206818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:44.217045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17992356-e9d1-465b-9fe9-69b023a4f6b3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.318488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35109-d09b-43e0-8ae9-1148dc152b18 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.327255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.328733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.329180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.329639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.332958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.334008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.365657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.372161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.372450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.372904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.373805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:44.376160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.379776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.402245 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1091/2171] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:44.409007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.422070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acab40a-9782-49a0-8967-da58a87ba20b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.429794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.431006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.431452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.431872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.432659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.434987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.536517 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1081/2172] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/users => generated 292 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:44.551531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.583564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b36f-7664-444f-a40f-97469962f4ba admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.588457 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1092/2173] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:44.591130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.731463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.732171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.732462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.732937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.734168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.735801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.757305 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1082/2174] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:18:44.763231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.780843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce923-3f90-443b-b0d1-2744db98d6a2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.792097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc8b1-58df-462a-8bf3-dd5e24aa68ff admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.795233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.796410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.797013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.797480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.798516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.800470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.806064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.806870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.807723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.808692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.809431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.815951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada613-8889-4606-a62e-1db00c0b91d3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.833690 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1083/2175] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:44.841913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:44.858116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc0d1-3813-41fa-93ad-5dd7fbc02c1f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:44.888387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:44.888387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.888387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.888702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] PATH_INFO: `/v3/projects/da141dca2d874d4bbb679cde1a089b7a/users/b278dc86c8bb4ee5abd24074c8450189/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:44.926379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da141dca2d874d4bbb679cde1a089b7a, user_id=b278dc86c8bb4ee5abd24074c8450189, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:44.932699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:44.993173 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1093/2176] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/users => generated 288 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:44.994747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:44.995227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:44.995512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.037904 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1084/2177] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:44 2022] PUT /identity/v3/projects/da141dca2d874d4bbb679cde1a089b7a/users/b278dc86c8bb4ee5abd24074c8450189/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:45.037904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.057430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] MFA Rules not processed for user `3477ec9af9274781ac4168c75f923458`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:45.059703 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.147825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22710c-9a15-4772-979e-a13ed8be0372 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.153554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.154541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.155250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.155990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.158206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.160012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad1615-81e8-4ba1-8c3b-13f3d20099a5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.175851 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1085/2178] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:45.175851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.175851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.175851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.193139 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1094/2179] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:45.194356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.197596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:45.198897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.207958 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1086/2180] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:45.208825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.210396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.211849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d2337-075f-4b6c-8ffa-8bbaa725cc7b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.217474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.218858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.218858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.218858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.219451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.221219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.232591 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1095/2181] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:45.235596 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.240535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.315816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539178-dbe8-405f-a67e-0d9ac598e253 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.322353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.328111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.328111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.328111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.328111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.333887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b930-f535-41a7-9ae9-c6e4301b9b0e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.338668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.339928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.339928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.340584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.352531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.354436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.365904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:45.371697 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1096/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:45.372669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.383740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1525a-1c1a-462b-a894-561bdbed06d2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.389022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.390059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.390493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.390913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] PATH_INFO: `/v3/projects/ac8066d2c0024b10b685f8bcdce94916/users/8be13a8e7d164a08828354a2a4e75973/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.425790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.427926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebac7-fbce-4f59-87a7-eb0051703608 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.430869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8066d2c0024b10b685f8bcdce94916, user_id=8be13a8e7d164a08828354a2a4e75973, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.434844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.441973 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1087/2183] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:45.682455 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1097/2184] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:45 2022] PUT /identity/v3/projects/ac8066d2c0024b10b685f8bcdce94916/users/8be13a8e7d164a08828354a2a4e75973/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:45.684992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7846d-bf3b-4113-9707-bf5fbdf70c8f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.685471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7846d-bf3b-4113-9707-bf5fbdf70c8f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.686056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7846d-bf3b-4113-9707-bf5fbdf70c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.746699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3ec7846d-bf3b-4113-9707-bf5fbdf70c8f None None] MFA Rules not processed for user `8be13a8e7d164a08828354a2a4e75973`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:45.748027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3ec7846d-bf3b-4113-9707-bf5fbdf70c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.821063 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1088/2185] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:45.833372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:45.835187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:45.940941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d2c6b-0758-4347-9812-54043c6fc4bf admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:45.947719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:45.949228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:45.950337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:45.950337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:45.963233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:45.968618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54a36d-5dfb-4483-a5ad-b8529a795c04 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:45.984764 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1098/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:47.376670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:48.921595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:50.556570 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:51.104949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.106008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.106461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.150441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] MFA Rules not processed for user `cb1bbc1683f24a5aa356438e533e1fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:51.151810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:51.258805 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1089/2187] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:53.550147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:54.567583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:55.840243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:55.840888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:55.841000 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:55.877696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] MFA Rules not processed for user `b278dc86c8bb4ee5abd24074c8450189`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:55.879315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:55.985120 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1099/2188] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:55.989795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.074453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bceee1f-2e22-40d0-add9-431ba9ca0056 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.080204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.080814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.081100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.081381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.082057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.084029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.285564 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1090/2189] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:56.289722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.300976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb97b6-95fa-4fe6-9ac0-cc020aacb6e0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.374972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.375609 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.375916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.376231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.376924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.379004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.551991 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1100/2190] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:56 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:56.562232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.577442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8720-ecb8-48d9-a6fa-b882bd7b790f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.582424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.583230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.583579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.583977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.584756 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.587209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.608346 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1091/2191] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:56.614884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.625643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2050e3-2b40-476d-9338-b202ec904e12 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.630511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.631172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.631453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.631728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] PATH_INFO: `/v3/projects/8cd2ed65409a4ca8a95b019f4c114735/users/a556af096e4e42a0a8d10be1bcfe54af/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.647199 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd2ed65409a4ca8a95b019f4c114735, user_id=a556af096e4e42a0a8d10be1bcfe54af, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.649888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.721509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:56.813504 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1101/2192] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:56 2022] PUT /identity/v3/projects/8cd2ed65409a4ca8a95b019f4c114735/users/a556af096e4e42a0a8d10be1bcfe54af/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:56.817286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.828909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184782bd-45b5-409b-af6d-130bc7a8ada5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.898933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.899542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.899856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.900273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.901215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.902851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaabf3-65bc-4d16-b099-bcb4a5c02293 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.930923 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1092/2193] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:56.932042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:56.947748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2746-348d-40f5-a2d0-56d5c5c22145 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.959987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.961018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.961306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.961604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] PATH_INFO: `/v3/projects/8cd2ed65409a4ca8a95b019f4c114735/users/a556af096e4e42a0a8d10be1bcfe54af/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.964642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd2ed65409a4ca8a95b019f4c114735, user_id=a556af096e4e42a0a8d10be1bcfe54af, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.969826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.994839 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1102/2194] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:56 2022] PUT /identity/v3/projects/8cd2ed65409a4ca8a95b019f4c114735/users/a556af096e4e42a0a8d10be1bcfe54af/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:00.669689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:05.573816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe4f77-4a08-48bb-b65b-ed2c2b1939e4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:05.574749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe4f77-4a08-48bb-b65b-ed2c2b1939e4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:05.574749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe4f77-4a08-48bb-b65b-ed2c2b1939e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:05.625667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5cfe4f77-4a08-48bb-b65b-ed2c2b1939e4 None None] MFA Rules not processed for user `a556af096e4e42a0a8d10be1bcfe54af`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:05.626930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5cfe4f77-4a08-48bb-b65b-ed2c2b1939e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:05.748471 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1093/2195] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:05.761213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:05.763232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:05.891950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dde4c-71a7-4405-bbcf-d41c7b99b024 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:05.896702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:05.900814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:05.901365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:05.902059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:05.999094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:06.000866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:06.012549 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1103/2196] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:06.300814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:06.565938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:06.565938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:06.565938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:06.595189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:06.596436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:06.652141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:06.654321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:06.760842 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1094/2197] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:06.775960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:06.777901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:06.807681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dad03-ae87-4673-a9ea-326cc6fbd52a service glance] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:06.814483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:06.815233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:06.815741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:06.816214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] PATH_INFO: `/v3/users/181870dc52884c3da93545754cded2b6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:06.817691 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=181870dc52884c3da93545754cded2b6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:06.820365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:06.887486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:06.925282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7c726-0e0c-479c-b8d3-9dc8c4e08d60 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:06.935272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:06.937194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:06.937788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:06.938352 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:06.951807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:06.953647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:06.965168 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1095/2198] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:19:07.073279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181870dc52884c3da93545754cded2b6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:07.206469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181870dc52884c3da93545754cded2b6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:07.219724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181870dc52884c3da93545754cded2b6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:07.221476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181870dc52884c3da93545754cded2b6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:07.275130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181870dc52884c3da93545754cded2b6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:07.283537 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1104/2199] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:06 2022] DELETE /identity/v3/users/181870dc52884c3da93545754cded2b6 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:07.715576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:07.736211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb938241-59e8-40b7-afeb-541293109ff8 service swift] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:07.871634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:07.872824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:07.873114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:07.873390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] PATH_INFO: `/v3/projects/95d307b5c73647b99396f19bc7ef676b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:07.874569 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d307b5c73647b99396f19bc7ef676b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:07.876964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:08.211554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d307b5c73647b99396f19bc7ef676b', 'request_id': 'req-f6d8fd83-3a25-4eb2-8533-56c52c017143'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:08.211554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d307b5c73647b99396f19bc7ef676b', 'request_id': 'req-f6d8fd83-3a25-4eb2-8533-56c52c017143'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:08.229005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d307b5c73647b99396f19bc7ef676b', 'request_id': 'req-f6d8fd83-3a25-4eb2-8533-56c52c017143'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:08.757266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] The token cache is being invalidate because project 95d307b5c73647b99396f19bc7ef676b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:08.765907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:08.765907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:08.765907 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1096/2200] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:07 2022] DELETE /identity/v3/projects/95d307b5c73647b99396f19bc7ef676b => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:08.766430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:08.768564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:08.788540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1721e-4756-47f9-a114-f35787b3e61c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:08.905660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:08.907642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:08.907642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:08.907642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] PATH_INFO: `/v3/users/ff4a5092538c4dde83110dbd7b82d666` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:08.914642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4a5092538c4dde83110dbd7b82d666)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:08.919937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:09.414126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4a5092538c4dde83110dbd7b82d666'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:09.492036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4a5092538c4dde83110dbd7b82d666'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:09.531081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4a5092538c4dde83110dbd7b82d666'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:09.532333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4a5092538c4dde83110dbd7b82d666'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:09.595222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79730538-db11-4a11-bfaa-ca442fc2c2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4a5092538c4dde83110dbd7b82d666'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:09.615198 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1105/2201] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:08 2022] DELETE /identity/v3/users/ff4a5092538c4dde83110dbd7b82d666 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:10.007394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:10.009108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:10.035753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8fd83-3a25-4eb2-8533-56c52c017143 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:10.143923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:10.144561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:10.145039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:10.145472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] PATH_INFO: `/v3/projects/3afefa4e157643f2b535ac1bc9a601cd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:10.148147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afefa4e157643f2b535ac1bc9a601cd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:10.150198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:10.361012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afefa4e157643f2b535ac1bc9a601cd', 'request_id': 'req-70418f9c-621e-4671-ba6f-4a3eff7e13c5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:10.367573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afefa4e157643f2b535ac1bc9a601cd', 'request_id': 'req-70418f9c-621e-4671-ba6f-4a3eff7e13c5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:10.375030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afefa4e157643f2b535ac1bc9a601cd', 'request_id': 'req-70418f9c-621e-4671-ba6f-4a3eff7e13c5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:10.599913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] The token cache is being invalidate because project 3afefa4e157643f2b535ac1bc9a601cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:10.600274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:10.601043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-70418f9c-621e-4671-ba6f-4a3eff7e13c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:10.603042 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1097/2202] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:10 2022] DELETE /identity/v3/projects/3afefa4e157643f2b535ac1bc9a601cd => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:10.608906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:10.609463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:10.613359 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:10.677991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:10.679395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:10.758950 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1106/2203] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:10.768718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:10.769706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:10.770612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:10.808907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:10.811101 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:10.839981 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1098/2204] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:10.844543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:10.858627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba90f-0568-44eb-9bfd-e5c079a6d6c8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:10.874647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:10.875634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:10.877220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:10.877516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:10.878337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:10.878653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:10.880469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:10.897031 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1107/2205] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:10.901258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:10.916410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40210e5-7154-4f84-9ca2-bb1f346a57a1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:10.922021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:10.922721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:10.928910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:10.928910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:10.928910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:10.928910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:11.233639 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1099/2206] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:10 2022] POST /identity/v3/projects => generated 385 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:11.238083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:11.249806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e885c3-165b-47a1-857a-e2afd42421c1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:11.337980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:11.338898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.339186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.339463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.340112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:11.342918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:11.515816 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1108/2207] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:11 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:11.519884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:11.533939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69b6-8f0f-4d69-9c0f-395863fdd5e0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:11.539430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:11.547902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.548516 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.549108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.549812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:11.551460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:11.568901 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1100/2208] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:11.572576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:11.587062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fd654-509c-4cbf-a647-532ce2585391 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:11.592688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:11.598465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.599218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.599695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.600403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:11.604377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116d21-901e-4962-8eec-4f2823c5c396 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:11.618280 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1109/2209] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:11.622187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:11.633318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e1de9-8338-4050-aba4-1e4a7b5db412 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:11.640255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:11.640924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.644137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.644137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] PATH_INFO: `/v3/projects/78045e57854c450893f959652295f040/users/a5b7b4faeae3416997c84a59ae473efe/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.661334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78045e57854c450893f959652295f040, user_id=a5b7b4faeae3416997c84a59ae473efe, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:11.667479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:11.871474 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1101/2210] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:11 2022] PUT /identity/v3/projects/78045e57854c450893f959652295f040/users/a5b7b4faeae3416997c84a59ae473efe/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:11.872382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.872382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.872382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.924118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] MFA Rules not processed for user `a5b7b4faeae3416997c84a59ae473efe`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:11.925719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:12.027076 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1110/2211] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:12.038820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:12.040981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:12.132130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c8fd4-cfa1-41f9-8c11-76130f8ed83a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:12.136853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:12.138493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:12.139259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:12.139936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:12.152496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:12.154821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52daf13-2ef3-40ce-9e28-4bad7c8222ad service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:12.176797 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1102/2212] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:12.207396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:12.220964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:12.290919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718ae90-1fc4-428e-b681-2ac807130068 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:12.297224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:12.297890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:12.298463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:12.298901 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] PATH_INFO: `/v3/users/a5b7b4faeae3416997c84a59ae473efe` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:12.300227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b7b4faeae3416997c84a59ae473efe)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:12.302236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:12.326967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:12.544083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b7b4faeae3416997c84a59ae473efe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:12.620451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b7b4faeae3416997c84a59ae473efe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:12.629694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b7b4faeae3416997c84a59ae473efe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:12.634801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b7b4faeae3416997c84a59ae473efe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:12.661286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b7b4faeae3416997c84a59ae473efe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:12.669425 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1111/2213] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:12 2022] DELETE /identity/v3/users/a5b7b4faeae3416997c84a59ae473efe => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:12.677326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:12.677876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:12.678221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:12.710303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:12.712137 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:12.826280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1103/2214] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:12.834221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:12.836721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:12.912709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f97d-d3d9-44e1-be5d-9280aeb88afa admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:12.925922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:12.926557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:12.927010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:12.927586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:12.948926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:12.950752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca530ad-141c-4744-ae49-50228d714114 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:12.964306 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1112/2215] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:13.516084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:13.651159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:13.653260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:13.665919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6db6-0cca-4673-a7da-c5212ac17308 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:13.673325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:13.674025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:13.674314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:13.674594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] PATH_INFO: `/v3/projects/78045e57854c450893f959652295f040` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:13.675795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78045e57854c450893f959652295f040)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:13.678084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:13.906095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78045e57854c450893f959652295f040', 'request_id': 'req-ec87560a-697a-49b2-9cee-ed9488cf781c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:13.921125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78045e57854c450893f959652295f040', 'request_id': 'req-ec87560a-697a-49b2-9cee-ed9488cf781c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:13.933127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78045e57854c450893f959652295f040', 'request_id': 'req-ec87560a-697a-49b2-9cee-ed9488cf781c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:14.819483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] The token cache is being invalidate because project 78045e57854c450893f959652295f040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:14.820052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:14.820457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ec87560a-697a-49b2-9cee-ed9488cf781c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:14.822008 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1104/2216] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:13 2022] DELETE /identity/v3/projects/78045e57854c450893f959652295f040 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:14.827644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:14.828099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:14.828196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:14.847268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:14.848463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:14.914828 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1113/2217] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:14.923711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:14.929967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:14.929967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:14.947133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:14.948351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:14.957129 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1105/2218] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:14.961401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:14.972336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5e3db-e54f-4cfc-a003-110aa57aa06a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:14.983463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:14.984292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:14.984769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:14.985094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:14.988474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:14.988783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:14.993290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.010506 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1114/2219] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:15.016452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.027093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724c02f-57aa-4ed6-818c-ebc254c6e601 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.038732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.038732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.038732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.038732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.039120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.039120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.188732 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1106/2220] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:15 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:15.192817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.208380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2fe63-16ed-418f-9873-00cc5314d77b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.283009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.283725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.284012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.284289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.285156 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.287755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.375851 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1115/2221] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:15 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:15.379870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.403544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b566d-043a-41c2-baef-664b49d89c0f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.409575 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.410419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.410870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.411314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.412105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.413991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.430893 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1107/2222] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:15.441677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.453142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae13557-3694-4b06-ac23-38b74adc91c3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.460066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:15.464989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.465373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.465736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.466323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.467368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.469626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7014ca-fddf-49c7-9b1f-823d18f31c5d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.489237 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1116/2223] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:15.493570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.520215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd23d30-84a3-43dc-b5b1-d86b9dba1304 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.526361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.527319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.529880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.530170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] PATH_INFO: `/v3/projects/da03f1b485f44bd682faa9ef77a3557c/users/cefeb892ad9e4f219d3b7129efe4a994/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.562886 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da03f1b485f44bd682faa9ef77a3557c, user_id=cefeb892ad9e4f219d3b7129efe4a994, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.565758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:15.766412 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1108/2224] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:15 2022] PUT /identity/v3/projects/da03f1b485f44bd682faa9ef77a3557c/users/cefeb892ad9e4f219d3b7129efe4a994/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:15.772233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9fcf-f4af-4a85-979a-d7036b015a51 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.773216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9fcf-f4af-4a85-979a-d7036b015a51 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.773638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9fcf-f4af-4a85-979a-d7036b015a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.803752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b9bb9fcf-f4af-4a85-979a-d7036b015a51 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:15.805253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b9bb9fcf-f4af-4a85-979a-d7036b015a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:15.883982 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1117/2225] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:15.895009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:15.897313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:15.971605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774b37-5fa7-4c38-9a8d-03ac1693e7e4 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:15.976761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:15.976761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:15.976761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:15.976761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:15.992603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:15.994418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:16.005943 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1109/2226] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:16.314664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:17.323189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:17.480046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:17.818007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b7f2-d308-46b2-90c2-f66fb73473f4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:17.818298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b7f2-d308-46b2-90c2-f66fb73473f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:17.818577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b7f2-d308-46b2-90c2-f66fb73473f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:17.875661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9802b7f2-d308-46b2-90c2-f66fb73473f4 None None] MFA Rules not processed for user `cefeb892ad9e4f219d3b7129efe4a994`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:17.876891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9802b7f2-d308-46b2-90c2-f66fb73473f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:17.967440 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1118/2227] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:17.982192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:17.984345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:18.053084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de51f-2070-4ba6-9202-57c7276e0de2 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:18.056686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:18.057299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:18.057580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:18.057951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:18.066790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:18.068229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738f3f-41f3-4d65-8406-76f5bc262f7f service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:18.078094 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1110/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:20.122398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550f46-f679-447f-bc71-89185163e647 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:20.122905 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550f46-f679-447f-bc71-89185163e647 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:20.123012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91550f46-f679-447f-bc71-89185163e647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:20.142100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-91550f46-f679-447f-bc71-89185163e647 None None] MFA Rules not processed for user `b278dc86c8bb4ee5abd24074c8450189`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:20.143403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-91550f46-f679-447f-bc71-89185163e647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:20.196598 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1119/2229] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:20.751243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:21.462454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:21.636804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:21.637320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:21.637794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:21.659531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] MFA Rules not processed for user `cefeb892ad9e4f219d3b7129efe4a994`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:21.660845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:21.668629 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1111/2230] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:24.576807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:25.708874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:25.709389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:25.709599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:25.729365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:25.730673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:25.786697 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1120/2231] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:25.808522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:25.810075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:25.876900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd7af-12a5-461f-8175-fc6fe3a7adaa None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:25.881675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:25.882300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:25.882579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:25.882851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:25.891100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:25.892677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39492b09-661b-48e2-a506-e1defdd6286b service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:25.900365 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1112/2232] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:26.014410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:27.490877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:29.008042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:29.426491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:31.650536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:32.833272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:34.142702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:35.273289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:37.231190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:37.797042 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:38.847597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:39.238491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:40.155790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:42.072851 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:42.074582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:42.088129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdddd6-30f7-4dde-9474-5a5054c1e8c6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:42.092679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:42.093301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:42.093578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:42.094062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] PATH_INFO: `/v3/users/8be13a8e7d164a08828354a2a4e75973` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:42.095306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be13a8e7d164a08828354a2a4e75973)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:42.097240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:42.278577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:42.489280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be13a8e7d164a08828354a2a4e75973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:42.556011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:42.592954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be13a8e7d164a08828354a2a4e75973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:42.600310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be13a8e7d164a08828354a2a4e75973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:42.602847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be13a8e7d164a08828354a2a4e75973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:42.614285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be13a8e7d164a08828354a2a4e75973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:42.620452 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1121/2233] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:42 2022] DELETE /identity/v3/users/8be13a8e7d164a08828354a2a4e75973 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:42.625222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:42.625511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:42.625789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:42.654657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:42.657678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:42.714637 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1113/2234] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:42.725042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:42.726536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:42.782677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360d7a3-65a7-45c8-ba50-2ffd45285051 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:42.786289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:42.786884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:42.787167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:42.787442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:42.796543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:42.798006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22ba13-c9ab-421f-9b59-890d10039d46 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:42.809104 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1122/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:43.448974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:43.451089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:43.464411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6a87-19c9-419d-9503-13fe9bf959c6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:43.469800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:43.470464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:43.470749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:43.471035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] PATH_INFO: `/v3/projects/ac8066d2c0024b10b685f8bcdce94916` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:43.472280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8066d2c0024b10b685f8bcdce94916)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:43.479025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:43.638274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8066d2c0024b10b685f8bcdce94916', 'request_id': 'req-bf02b2bd-683c-4969-a5b4-18450947fe61'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:43.643432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8066d2c0024b10b685f8bcdce94916', 'request_id': 'req-bf02b2bd-683c-4969-a5b4-18450947fe61'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:43.649528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8066d2c0024b10b685f8bcdce94916', 'request_id': 'req-bf02b2bd-683c-4969-a5b4-18450947fe61'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:43.801256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] The token cache is being invalidate because project ac8066d2c0024b10b685f8bcdce94916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:43.801549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:43.802830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-bf02b2bd-683c-4969-a5b4-18450947fe61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:43.803737 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1114/2236] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:43 2022] DELETE /identity/v3/projects/ac8066d2c0024b10b685f8bcdce94916 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:43.808796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:43.809471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:43.809471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:43.844829 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:43.844829 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:43.891028 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1123/2237] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:43.899909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:43.900288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:43.900636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:43.921742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:43.923133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:43.931242 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1115/2238] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:43.935912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:43.945708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb20992-a614-492e-b717-e9abafec47c6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:43.950964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:43.955495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:43.967461 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1124/2239] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:43.971730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:43.982880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad71024-ae15-4a60-a68a-d59243b33eb7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:43.987503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:43.988098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:43.988377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:43.988650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:43.989315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:43.991256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.162861 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1116/2240] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:43 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:44.166926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.175238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:44.179080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91b0a7-a4a3-4622-af69-7b8b7fe33e88 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.233020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.233602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.233907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.234185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.234817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.236736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.334945 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1125/2241] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:44 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:44.338971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.350000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36e870-98f4-4ed7-ad2c-37cbb38ff794 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.354549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.358428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.358428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.358428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.358428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.358428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.368265 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1117/2242] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:44.372250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.382735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404c47-eaf8-4c3b-812c-0600f4e7f3eb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.387382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.388530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.388907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.389083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.389733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.391393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce35d6-09fa-4c7d-bace-53e90f248467 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.404423 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1126/2243] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:44.407494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.417876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b6ca-faf9-41eb-836f-529c37159932 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.422689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.423407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.423778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.424127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] PATH_INFO: `/v3/projects/8b352ef7ca654af2963c25f5d9ec0af4/users/08347e76b451484eacaad8af774e14d7/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.440168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b352ef7ca654af2963c25f5d9ec0af4, user_id=08347e76b451484eacaad8af774e14d7, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.443324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.544743 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1118/2244] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:44 2022] PUT /identity/v3/projects/8b352ef7ca654af2963c25f5d9ec0af4/users/08347e76b451484eacaad8af774e14d7/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:44.554961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.555250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.555526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.583838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] MFA Rules not processed for user `08347e76b451484eacaad8af774e14d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:44.585037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:44.647406 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1127/2245] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:44.654387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.718629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31a26-19ad-4521-8503-4487a5b1495d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.718629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.718955 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.719353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.719632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.720264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.722185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:44.900026 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1119/2246] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:44 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:44.904455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:44.915466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ff6d4-1b7a-4a74-8fb1-1e7807646f3f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:44.982810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:44.983428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:44.983706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:44.983978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:44.986234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:44.988320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:45.169610 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1128/2247] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:44 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:45.173519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:45.184173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed97a9-8b02-4292-825d-b7173b68c06d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:45.189277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:45.189959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.190240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.190518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.191168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:45.192793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:45.204943 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1120/2248] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:45.208975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:45.220085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e0d2-c282-4626-be6c-10ff7a3aa70a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:45.224892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:45.225436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.225893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.226176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.226853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:45.228474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667245c9-c5d0-4788-a584-4487f03c1612 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:45.239884 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1129/2249] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:45.243906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:45.254125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1ce7-c40d-4513-8fe1-7e1a05392f49 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:45.259104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:45.259758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.260040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.260313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] PATH_INFO: `/v3/projects/c923139dbc14429f91812bfdbf8ee26a/users/c6844eba89264c96a095d35aeac4a400/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.276260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c923139dbc14429f91812bfdbf8ee26a, user_id=c6844eba89264c96a095d35aeac4a400, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:45.280271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:45.363926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:45.430506 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1121/2250] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:45 2022] PUT /identity/v3/projects/c923139dbc14429f91812bfdbf8ee26a/users/c6844eba89264c96a095d35aeac4a400/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:45.442325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.442618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.442896 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.470396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] MFA Rules not processed for user `c6844eba89264c96a095d35aeac4a400`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:45.471743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:45.535052 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1130/2251] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:45.539662 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:45.601259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c77dd0-63a9-4506-ab95-42e1dd76aa25 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:45.605976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:45.606798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.607132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.607413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.608060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:45.610035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:45.810062 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1122/2252] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:45.814269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:45.827668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bcd6-22b4-4a73-80d8-25b9c5bd9349 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:45.884013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:45.884623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:45.884904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:45.885195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:45.885994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:45.888236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.062974 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1131/2253] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:45 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:46.067788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.080586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4446f26-0a4c-4c58-b2ed-90034159f2f1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.085781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.086594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.087060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.087494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.088145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.089923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.104325 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1123/2254] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:46.113097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.123837 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e504c50-97e4-4386-b244-8250b8bbd3de admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.131285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.131961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.132238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.132515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] PATH_INFO: `/v3/projects/c704d0dc49174e48a8ad8cce48649d06/users/4ba622b23540467da9aee6abb98d48b7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.137198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:46.150706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c704d0dc49174e48a8ad8cce48649d06, user_id=4ba622b23540467da9aee6abb98d48b7, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.154206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.291599 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1132/2255] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:46 2022] PUT /identity/v3/projects/c704d0dc49174e48a8ad8cce48649d06/users/4ba622b23540467da9aee6abb98d48b7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:46.307554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.318333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11712-e51d-4901-b837-fb2624c7f44e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.381138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.381810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.382114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.382557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.383269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.385045 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30e699-20e2-4b29-8de8-511aba7bd78d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.401272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.407681 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1124/2256] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:46.413022 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22ae81-08f4-42a7-9228-c9f796f2c0dd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.419907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.420826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.421256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.421677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] PATH_INFO: `/v3/projects/c704d0dc49174e48a8ad8cce48649d06/users/4ba622b23540467da9aee6abb98d48b7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.425358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c704d0dc49174e48a8ad8cce48649d06, user_id=4ba622b23540467da9aee6abb98d48b7, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.428453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.442522 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1133/2257] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:46 2022] PUT /identity/v3/projects/c704d0dc49174e48a8ad8cce48649d06/users/4ba622b23540467da9aee6abb98d48b7/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:46.453566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.453894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.459121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.484637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] MFA Rules not processed for user `4ba622b23540467da9aee6abb98d48b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:46.485905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:46.563383 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1125/2258] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:46.575568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.577293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:46.638931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9d3f-fc08-4154-814d-40db26fc8a84 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.642939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.643575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.643858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.644131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.698964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.701307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.711108 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1134/2259] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:47.019785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:48.207190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:49.017078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:50.069822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:50.079112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.088653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02955-32f5-4402-86e1-de600ac3c7c3 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.092705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.093309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.093595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.093903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.151961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.153641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.163026 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1126/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:51.167605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:51.301270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:51.949272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:51.958304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652d9b-3934-4d75-b4c7-44c36789d1ce service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:51.961993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:51.968885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:51.968885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:51.968885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:51.972567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:51.974194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e64710-5166-4cd7-8c4f-1f11e5c75814 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:51.987187 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1135/2261] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:52.786890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:53.392450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:53.582798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:53.584202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:53.618141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:53.655238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c721a-59ea-4b16-832e-156c07d9815f service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:53.659833 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:53.660493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:53.660775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:53.661050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] PATH_INFO: `/v3/users/c338586d8b8244bd87d8234c5e11cf03` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:53.662354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c338586d8b8244bd87d8234c5e11cf03)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:53.664295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:53.958931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c338586d8b8244bd87d8234c5e11cf03'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:53.967527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c338586d8b8244bd87d8234c5e11cf03'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.139314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c338586d8b8244bd87d8234c5e11cf03'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.139960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c338586d8b8244bd87d8234c5e11cf03'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.153171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c338586d8b8244bd87d8234c5e11cf03'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.159272 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1127/2262] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:53 2022] DELETE /identity/v3/users/c338586d8b8244bd87d8234c5e11cf03 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:54.163694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.164077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.164433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.183320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:54.184774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:54.243643 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1136/2263] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:54.257712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:54.259189 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:54.318950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5acb-8b94-4004-8cbf-09064214ccb8 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:54.322505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:54.323104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.323642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.323944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.333595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:54.335077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347560-74d9-408b-9bba-d874f06d4d20 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:54.345607 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1128/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:54.716547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:54.882911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:54.884864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:54.901244 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b868dc-b2aa-46b9-ba54-4efc90fcf26e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:54.907697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:54.908693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.908974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.909327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] PATH_INFO: `/v3/projects/a81df2d157094b4bbb0507c5da446ffb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.911528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81df2d157094b4bbb0507c5da446ffb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:54.913560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:54.963898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:55.067065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81df2d157094b4bbb0507c5da446ffb', 'request_id': 'req-74252ac2-6739-48e8-952f-07a7d98a5379'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:55.073141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81df2d157094b4bbb0507c5da446ffb', 'request_id': 'req-74252ac2-6739-48e8-952f-07a7d98a5379'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:55.080190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81df2d157094b4bbb0507c5da446ffb', 'request_id': 'req-74252ac2-6739-48e8-952f-07a7d98a5379'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:55.218756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:55.224778 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] The token cache is being invalidate because project a81df2d157094b4bbb0507c5da446ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:55.225079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:55.225728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-74252ac2-6739-48e8-952f-07a7d98a5379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:55.229299 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1137/2265] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:54 2022] DELETE /identity/v3/projects/a81df2d157094b4bbb0507c5da446ffb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:55.235188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291766-dc68-4643-900e-b3687687b27a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.235474 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291766-dc68-4643-900e-b3687687b27a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.235754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291766-dc68-4643-900e-b3687687b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.255048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f2291766-dc68-4643-900e-b3687687b27a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:55.256277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f2291766-dc68-4643-900e-b3687687b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:55.316593 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1129/2266] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:55.324549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.324851 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.326950 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.346357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:55.347635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:55.356471 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1138/2267] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:55.360752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291766-dc68-4643-900e-b3687687b27a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.370228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291766-dc68-4643-900e-b3687687b27a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.374983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.375572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.375851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.376124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.376762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:55.377065 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.378696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.389966 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1130/2268] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:55.394119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.404064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bb40-5dfc-4c9f-ab93-d01d881d067f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.408886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.409509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.413128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.413128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.413128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.413128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.501317 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1139/2269] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:55.505618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.516244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd891a5a-e593-4356-9ece-fd3523176c9d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.570983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.571573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.571855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.572131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.572757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.575583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.729031 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1131/2270] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:55.733124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.743660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8609fd8-dc00-4f03-a317-9830b065437a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.748279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.748955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.749141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.749432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.750119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.751731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.761448 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1140/2271] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:55.766195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.776138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1954a08-5342-4975-93eb-f72c48e35c5c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.781333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.781956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.782237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.782539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.783451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.785230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1bf00-7c9e-49b2-bcf9-aa198010dbb7 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.796825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1132/2272] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:55.800988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.812968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48bff-2ee7-41fa-8b4a-9465be160226 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.819740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.820522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.820874 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.821153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] PATH_INFO: `/v3/projects/0ce84023122548d4836b9dc30ee1395d/users/2688855a64984efdbb0847b1480e135d/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.839913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce84023122548d4836b9dc30ee1395d, user_id=2688855a64984efdbb0847b1480e135d, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.843278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.957742 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1141/2273] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:55 2022] PUT /identity/v3/projects/0ce84023122548d4836b9dc30ee1395d/users/2688855a64984efdbb0847b1480e135d/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:55.969454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.969888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.970060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.998239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] MFA Rules not processed for user `2688855a64984efdbb0847b1480e135d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:55.999454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.045197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:56.065821 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1133/2274] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:56.077909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:56.079584 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.101425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:56.138788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb418-6c25-4265-8fda-808f76ade294 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:56.142506 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:56.143114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:56.143396 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:56.143676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:56.152200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:56.153681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f25d5c-bacc-460e-ada6-d87f05472758 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:56.162523 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1142/2275] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:56.187119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:56.248996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3ab0a-6dd1-47e1-9e65-d15c8e4c0673 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:56.253672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:56.254366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:56.254650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:56.254926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] PATH_INFO: `/v3/users/2688855a64984efdbb0847b1480e135d` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:56.256093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2688855a64984efdbb0847b1480e135d)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:56.258077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:56.504512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2688855a64984efdbb0847b1480e135d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:56.512562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2688855a64984efdbb0847b1480e135d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:56.627008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2688855a64984efdbb0847b1480e135d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:56.627861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2688855a64984efdbb0847b1480e135d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:56.641040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2688855a64984efdbb0847b1480e135d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:56.647322 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1134/2276] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:56 2022] DELETE /identity/v3/users/2688855a64984efdbb0847b1480e135d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:56.652201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:56.653009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:56.653311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:56.673803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:56.675406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.744228 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1143/2277] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:56.757149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:56.757149 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.812058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390072b-cce3-43b0-b351-56b046543a50 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:56.815614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:56.816205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:56.816483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:56.816752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:56.826806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:56.831035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445e562-3518-463e-94f3-6f8aca57ecd4 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:56.837718 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1135/2278] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:56.859181 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:57.201751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:57.403194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:57.404647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:57.416439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181cc2-1572-4cd1-8797-a992dfab42bf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:57.421200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:57.421881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:57.422164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:57.422439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] PATH_INFO: `/v3/projects/0ce84023122548d4836b9dc30ee1395d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:57.423553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce84023122548d4836b9dc30ee1395d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:57.425496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:57.603421 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce84023122548d4836b9dc30ee1395d', 'request_id': 'req-802f560d-45e3-4f59-b224-1a3561bfa029'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:57.609068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce84023122548d4836b9dc30ee1395d', 'request_id': 'req-802f560d-45e3-4f59-b224-1a3561bfa029'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:57.615770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce84023122548d4836b9dc30ee1395d', 'request_id': 'req-802f560d-45e3-4f59-b224-1a3561bfa029'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:57.801908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] The token cache is being invalidate because project 0ce84023122548d4836b9dc30ee1395d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:57.820642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:57.820642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-802f560d-45e3-4f59-b224-1a3561bfa029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:57.820642 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1144/2279] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:57 2022] DELETE /identity/v3/projects/0ce84023122548d4836b9dc30ee1395d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:57.824748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:57.825509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:57.825664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:57.856591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:57.858304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:57.928814 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1136/2280] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:57.937624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:57.937941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:57.938216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:57.957438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:57.958667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:57.966619 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1145/2281] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:57.970983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:57.981743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d7172-6b33-4e5b-b22a-d5cc2bddcfdc None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:57.988155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:57.988780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:57.993377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:57.993377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:57.993377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:57.993377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:57.993377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.004829 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1137/2282] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:58.009247 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.018521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e4d71-4f47-4d46-a94f-3abdd4356fea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.023144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.023739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.024020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.024294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.024913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.026853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.153422 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1146/2283] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:58 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:58.155178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.165417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23220b-42c6-43c6-9d68-1474e29fb104 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.235362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.236254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.236535 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.236812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.237446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.239764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.412425 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1138/2284] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:58 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:58.414363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.447582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.456054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:58.471210 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbc7-d321-42ff-b603-c926860b5537 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.490406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470ee9-124d-4db7-b128-7f97047130dc admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.498927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.499940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.500415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.500661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.500866 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.501806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.501982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.502755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.503246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] PATH_INFO: `/v3/users/08347e76b451484eacaad8af774e14d7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.505228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.506336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08347e76b451484eacaad8af774e14d7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.514500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.544907 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1147/2285] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:58.548931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.568911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27e86-155d-4131-9dfe-66045daedd73 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.577433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.578428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.578925 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.579416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.580588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.583647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.606305 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1148/2286] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:58.610573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.642378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f782-c909-4552-8e24-23e02790bc62 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:58.669176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:58.669915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.674820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.675872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] PATH_INFO: `/v3/projects/70517767ce9d4cf9b59d91dbc046adeb/users/df0eac32d89a43649ddc9843eb74d25c/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.710688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70517767ce9d4cf9b59d91dbc046adeb, user_id=df0eac32d89a43649ddc9843eb74d25c, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:58.714660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f1df-7e83-436b-9375-593d3bc11d6a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:58.741160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08347e76b451484eacaad8af774e14d7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:58.765086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08347e76b451484eacaad8af774e14d7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:58.840650 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1149/2287] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:58 2022] PUT /identity/v3/projects/70517767ce9d4cf9b59d91dbc046adeb/users/df0eac32d89a43649ddc9843eb74d25c/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:58.850250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.850795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.851119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.875308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08347e76b451484eacaad8af774e14d7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:58.875820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:58.876808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08347e76b451484eacaad8af774e14d7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:58.883814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] MFA Rules not processed for user `df0eac32d89a43649ddc9843eb74d25c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:58.885040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:58.892245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9cdea595-b2ea-439c-937b-3790fcf8a93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08347e76b451484eacaad8af774e14d7'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:58.898906 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1139/2288] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:58 2022] DELETE /identity/v3/users/08347e76b451484eacaad8af774e14d7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:58.903558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.903846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.904119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.924781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:58.926259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:58.975924 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1150/2289] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:58.991725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:58.993173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:59.002519 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1140/2290] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:59.012225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:59.013800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:59.050551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df2ff-e765-4874-a368-1bdc2207d3f5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:59.056900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:59.071202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193256f-8053-4677-8e6e-d9d9836b4df2 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:59.075267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:59.075873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:59.076157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:59.076441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:59.085547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:59.087043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:59.097159 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1141/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:59.099268 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:59.099877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:59.100155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:59.100786 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:59.164303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:59.165815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:59.176484 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1151/2292] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:59.927908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:59.931270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:59.945331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a2329-8304-4972-a191-d39efc928106 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:59.957490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:59.957490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:59.957490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:59.957490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] PATH_INFO: `/v3/projects/8b352ef7ca654af2963c25f5d9ec0af4` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:59.958436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b352ef7ca654af2963c25f5d9ec0af4)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:59.958436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:00.181824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b352ef7ca654af2963c25f5d9ec0af4', 'request_id': 'req-25f6cea3-be35-45cb-9878-130ff5824004'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.188318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b352ef7ca654af2963c25f5d9ec0af4', 'request_id': 'req-25f6cea3-be35-45cb-9878-130ff5824004'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.194568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b352ef7ca654af2963c25f5d9ec0af4', 'request_id': 'req-25f6cea3-be35-45cb-9878-130ff5824004'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.349275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] The token cache is being invalidate because project 8b352ef7ca654af2963c25f5d9ec0af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:00.349810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.351194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.353031 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1142/2293] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:59 2022] DELETE /identity/v3/projects/8b352ef7ca654af2963c25f5d9ec0af4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:00.367438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:00.378836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b48b-c3ba-4150-b97b-fce2ca570e1d service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:00.433702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:00.434104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:00.434399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:00.434693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] PATH_INFO: `/v3/users/c6844eba89264c96a095d35aeac4a400` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:00.435824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6844eba89264c96a095d35aeac4a400)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:00.437749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:00.667370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6844eba89264c96a095d35aeac4a400'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:00.984653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6844eba89264c96a095d35aeac4a400'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:01.001745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6844eba89264c96a095d35aeac4a400'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:01.039331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6844eba89264c96a095d35aeac4a400'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:01.039331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6844eba89264c96a095d35aeac4a400'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:01.039331 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1152/2294] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:00 2022] DELETE /identity/v3/users/c6844eba89264c96a095d35aeac4a400 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:02.601298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:02.603738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:02.628897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6cea3-be35-45cb-9878-130ff5824004 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:02.735299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:02.736143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:02.736761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:02.737798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] PATH_INFO: `/v3/projects/c923139dbc14429f91812bfdbf8ee26a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:02.742564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c923139dbc14429f91812bfdbf8ee26a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:02.742564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:02.896370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c923139dbc14429f91812bfdbf8ee26a', 'request_id': 'req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:02.903749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c923139dbc14429f91812bfdbf8ee26a', 'request_id': 'req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:02.911264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c923139dbc14429f91812bfdbf8ee26a', 'request_id': 'req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.015887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:03.054611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] The token cache is being invalidate because project c923139dbc14429f91812bfdbf8ee26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:03.055072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.056522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.060435 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1143/2295] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:02 2022] DELETE /identity/v3/projects/c923139dbc14429f91812bfdbf8ee26a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:03.064495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:03.067111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:03.092081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c10a08-541a-45e1-84cf-32781d750858 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:03.135715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:03.137894 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:03.273038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:03.274939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:03.275648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:03.276218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] PATH_INFO: `/v3/users/4ba622b23540467da9aee6abb98d48b7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:03.278057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba622b23540467da9aee6abb98d48b7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:03.284582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c0d0-aa7a-46e1-be6c-cae85d1304bc admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:03.285354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:03.290043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:03.290878 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:03.291460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:03.291903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:03.294808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:03.310072 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:03.311925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:03.332037 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1144/2296] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:03.580186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba622b23540467da9aee6abb98d48b7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.704122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba622b23540467da9aee6abb98d48b7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.712077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba622b23540467da9aee6abb98d48b7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.712848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba622b23540467da9aee6abb98d48b7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.726771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24f82e96-b46b-4b1d-819c-7871e48e62c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba622b23540467da9aee6abb98d48b7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:03.738006 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1153/2297] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:03 2022] DELETE /identity/v3/users/4ba622b23540467da9aee6abb98d48b7 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:04.252591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:04.591200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:04.594224 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:04.615036 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6a73-f6d2-4479-ae9c-8aa43a5ac5f5 service placement] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:04.708215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:04.708954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:04.709477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:04.709827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] PATH_INFO: `/v3/projects/c704d0dc49174e48a8ad8cce48649d06` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:04.711853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c704d0dc49174e48a8ad8cce48649d06)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:04.714115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:04.924111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c704d0dc49174e48a8ad8cce48649d06', 'request_id': 'req-00d9002e-2dcc-4be2-ab72-caec37cfc868'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:04.930162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c704d0dc49174e48a8ad8cce48649d06', 'request_id': 'req-00d9002e-2dcc-4be2-ab72-caec37cfc868'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:04.936654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c704d0dc49174e48a8ad8cce48649d06', 'request_id': 'req-00d9002e-2dcc-4be2-ab72-caec37cfc868'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:05.023552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] The token cache is being invalidate because project c704d0dc49174e48a8ad8cce48649d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:05.023822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:05.024491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-00d9002e-2dcc-4be2-ab72-caec37cfc868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:05.026204 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1145/2298] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:04 2022] DELETE /identity/v3/projects/c704d0dc49174e48a8ad8cce48649d06 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:05.031776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.032071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.032351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.052608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:05.053856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:05.113693 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1154/2299] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:05.121970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.122372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.122640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.149125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:05.150347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:05.158923 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1146/2300] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:05.163147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.173398 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e48f6-0faf-411d-94cd-e7b7bd5f8212 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.178159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.178756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.180446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.180446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.180446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:05.180446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.181856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.195181 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1155/2301] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:05.199870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.209156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6313-b480-46d2-a62c-f0e0b75803dc None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.214788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.214788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.214788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.215636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.216353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.218321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.397339 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1147/2302] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:05.401169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.411948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50cb61-2873-43a8-8c05-8eb385190e0a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.473007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b951d-d175-474d-842e-d012c653186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.479787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b951d-d175-474d-842e-d012c653186e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.479787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b951d-d175-474d-842e-d012c653186e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.479787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b951d-d175-474d-842e-d012c653186e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.479787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b951d-d175-474d-842e-d012c653186e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.479787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b951d-d175-474d-842e-d012c653186e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.599739 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1156/2303] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:05 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:05.601080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.614958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5ec6-8d81-4a65-849c-af3c10b66d4c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.619911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.620571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.620851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.621127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.622780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.624375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.634718 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1148/2304] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:05.638852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b951d-d175-474d-842e-d012c653186e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.661579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b951d-d175-474d-842e-d012c653186e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.666727 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.667338 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.667636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.667903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.669207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.671016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a05c3-c5dc-4a3a-a8df-2f83e5b72f15 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.685301 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1157/2305] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:05.689437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.702349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c018f-9952-4169-90c1-d3438cd689ff admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.707315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.708002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.708529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.708807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] PATH_INFO: `/v3/projects/353873cbb26147b2b8be0d3ed43b7fa0/users/04a4650ba74042c5954d9374c4bb1fec/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.725281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353873cbb26147b2b8be0d3ed43b7fa0, user_id=04a4650ba74042c5954d9374c4bb1fec, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.728046 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.865327 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1149/2306] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:05 2022] PUT /identity/v3/projects/353873cbb26147b2b8be0d3ed43b7fa0/users/04a4650ba74042c5954d9374c4bb1fec/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:05.938151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.938796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.939292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.971490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] MFA Rules not processed for user `04a4650ba74042c5954d9374c4bb1fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:05.972861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:06.046798 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1158/2307] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:06.051327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:06.120568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467859-4fc1-4baa-b921-322d788dae79 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:06.125410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:06.126249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.126700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.127122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.127913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:06.130040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:06.265702 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1150/2308] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:06 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:06.267006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:06.279012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9946204-99c5-42d6-9b06-bef33a2c6141 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:06.349165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:06.350452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.350681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.351012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.351643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:06.354450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:06.502883 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1159/2309] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:06 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:06.507397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:06.519264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb90d-a5e6-40dc-b2fa-984d898f7157 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:06.524875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:06.525903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.526385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.526931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.538879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:06.542408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:06.567937 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1151/2310] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:06.568793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:06.580742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056138b-d256-4e6d-a1b8-1e535b7f098f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:06.586819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:06.588051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.588051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.588476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.588742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:06.590947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0818-cb51-4f3b-9e6a-85937f5c5779 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:06.606343 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1160/2311] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:20:06.607930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:06.631180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a46b37-846c-421f-b8c4-e695d079d73b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:06.636634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:06.637555 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.638173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.638527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] PATH_INFO: `/v3/projects/6ad819142f8848e5b6568c8c49989440/users/a5e0f8f50a8b4632bb97b142c4ab3f62/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.658893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad819142f8848e5b6568c8c49989440, user_id=a5e0f8f50a8b4632bb97b142c4ab3f62, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:06.675898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:06.835598 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1152/2312] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:06 2022] PUT /identity/v3/projects/6ad819142f8848e5b6568c8c49989440/users/a5e0f8f50a8b4632bb97b142c4ab3f62/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:06.847197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:06.847483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:06.847763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:06.874722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] MFA Rules not processed for user `a5e0f8f50a8b4632bb97b142c4ab3f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:06.875917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:06.937299 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1161/2313] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:06.941913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.029337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44955d-a469-4587-a0ef-7561ea3e2f22 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.035729 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.036596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.037044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.037466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.038302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.040618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.160709 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1153/2314] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:06 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:07.164969 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.197092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343be23-e6c0-406f-8aaa-dabf7a587f94 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.272902 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.273528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.273812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.274137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.274771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.276735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.421331 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1162/2315] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:07 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:07.430916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.441899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82350c18-2578-4afa-9bfb-6fb85a50306e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.446384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.446970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.447251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.447523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.448237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.450808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.462422 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1154/2316] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:20:07.468640 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.478530 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b45-7c35-4f7d-be6d-774b18e1fc25 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.484052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.484741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.485029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.485306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] PATH_INFO: `/v3/projects/5171c0a329a54bf8a71ce66906c472de/users/b7b575005a6d48b4b5430198f5279da2/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.500320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5171c0a329a54bf8a71ce66906c472de, user_id=b7b575005a6d48b4b5430198f5279da2, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.503331 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.589503 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1163/2317] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:07 2022] PUT /identity/v3/projects/5171c0a329a54bf8a71ce66906c472de/users/b7b575005a6d48b4b5430198f5279da2/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:07.593645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.603412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929aed1-245b-498d-9d69-0217bdcd922b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.659986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.660702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.661005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.661172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.661822 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.663475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed931-dbfe-40f8-ae99-f8644d9600d3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.677804 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1155/2318] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:07.678776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.697259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc49d9-7e68-42e4-92c6-51a37e5c133a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.703549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.704217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.704504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.704782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] PATH_INFO: `/v3/projects/5171c0a329a54bf8a71ce66906c472de/users/b7b575005a6d48b4b5430198f5279da2/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.706773 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5171c0a329a54bf8a71ce66906c472de, user_id=b7b575005a6d48b4b5430198f5279da2, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.709505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.721919 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1164/2319] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:07 2022] PUT /identity/v3/projects/5171c0a329a54bf8a71ce66906c472de/users/b7b575005a6d48b4b5430198f5279da2/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:07.731801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.732094 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.732376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.777267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] MFA Rules not processed for user `b7b575005a6d48b4b5430198f5279da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:07.778754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.881872 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1156/2320] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:07.889774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:07.891257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.893558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.959071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbdba1-ec68-48ff-953c-90211176db0a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.962873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.963475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.963755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.964029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:08.025821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:08.027309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:08.038693 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1165/2321] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:08.190004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:10.348383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:10.595689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:11.431075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:11.435330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:11.447264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2a3e-6d00-4744-b4df-6049a2e51fa9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:11.451325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:11.451953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:11.452235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:11.452597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:11.553023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:11.556304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417d5e-7ade-49ce-a714-708d447b5a2c service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:11.571502 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1157/2322] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:12.353333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:14.030695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:14.037721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:14.048128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f848c-de6e-4d0e-865d-3cd8ebdd1510 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:14.051947 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:14.052556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:14.052839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:14.053248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:14.063074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:14.064525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:14.080991 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1166/2323] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:15.923521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee25c6-7f0d-4aad-bb89-3783e9d00b5f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:15.924931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee25c6-7f0d-4aad-bb89-3783e9d00b5f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:15.924931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee25c6-7f0d-4aad-bb89-3783e9d00b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:15.942930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7fee25c6-7f0d-4aad-bb89-3783e9d00b5f None None] MFA Rules not processed for user `cefeb892ad9e4f219d3b7129efe4a994`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:15.944126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7fee25c6-7f0d-4aad-bb89-3783e9d00b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:16.000655 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1158/2324] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:16.182823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:16.184927 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:16.219007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:16.279730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b3f77-5bfe-4ea3-8ce7-aee150c35bc5 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:16.285196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:16.287327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.287327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.287327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] PATH_INFO: `/v3/users/df0eac32d89a43649ddc9843eb74d25c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.288861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0eac32d89a43649ddc9843eb74d25c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:16.292354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:16.413245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:16.618824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0eac32d89a43649ddc9843eb74d25c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:16.747541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0eac32d89a43649ddc9843eb74d25c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:16.758985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0eac32d89a43649ddc9843eb74d25c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:16.759759 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0eac32d89a43649ddc9843eb74d25c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:16.773166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0eac32d89a43649ddc9843eb74d25c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:16.781423 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1167/2325] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:16 2022] DELETE /identity/v3/users/df0eac32d89a43649ddc9843eb74d25c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:16.786623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.787215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.787795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.809586 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:16.811121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:16.879808 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1159/2326] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:16.890151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:16.891585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:16.956292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76dac-caa1-40ca-80da-5f59aa9a0948 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:16.960693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:16.961292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.961576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.961868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.972780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:16.974310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:16.985074 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1168/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:17.444694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:17.446160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:17.464754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b7b3a-7679-44c2-aae8-b2c0cee5568d None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:17.494498 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:17.495354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.495791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.496261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] PATH_INFO: `/v3/projects/70517767ce9d4cf9b59d91dbc046adeb` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.497808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70517767ce9d4cf9b59d91dbc046adeb)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:17.500337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:17.648095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:17.666059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e430-6c58-492e-b9e5-676540673b9d service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:17.666059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:17.666059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.666059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.666582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.669002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:17.730564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70517767ce9d4cf9b59d91dbc046adeb', 'request_id': 'req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:17.737229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70517767ce9d4cf9b59d91dbc046adeb', 'request_id': 'req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:17.746918 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70517767ce9d4cf9b59d91dbc046adeb', 'request_id': 'req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:17.753500 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:17.755114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b1845-f173-41ec-9122-d714edd5bcdf service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:17.767148 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1169/2328] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:17.926663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] The token cache is being invalidate because project 70517767ce9d4cf9b59d91dbc046adeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:17.927123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:17.927758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d4a7c8dd-105d-4aa5-801a-99c1d0eb5ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:17.929253 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1160/2329] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:17 2022] DELETE /identity/v3/projects/70517767ce9d4cf9b59d91dbc046adeb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:17.934751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.935049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.935322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.955413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:17.956614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:18.023254 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1170/2330] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:18.031244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.031530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.031806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.053428 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:18.054676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:18.067407 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1161/2331] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:18.078334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.088085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19759ed6-3a08-4279-aa66-f0eaadcbf6a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.093071 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.093677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.093989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.094266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.094920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:18.095224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.096820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.108944 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1171/2332] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:18.113372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.123395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab33f6-a142-4a41-801a-315ce96cbb89 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.128406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.129258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.129745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.130207 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.130841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.132873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.247290 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1162/2333] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:18 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:18.248808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.259104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89446a7-533c-43a0-ae56-9d15c908fb66 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.318509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.319116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.319394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.319665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.320290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.322316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.441380 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1172/2334] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:18 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:18.445748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.463932 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9848a-c6e3-4386-a486-d8732d1bbaf1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.487216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.487650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.488096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.488678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.489341 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.491362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.503376 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1163/2335] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:18.507507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.524262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323c37-00ee-4aa9-8014-087b24e43423 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.530067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.530681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.531199 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.531488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.532165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.534054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a37d7-d84e-41c1-97a4-91d16453c5cb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.545335 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1173/2336] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:18.552398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.564081 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd912e-a215-4b78-8142-052b5a84826c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.583823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.584698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.584983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.585419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] PATH_INFO: `/v3/projects/06acb283273b4e988069aa1a8e78d584/users/1543a3e8609048d9b03b10aebf656fe6/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.596337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:18.630755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06acb283273b4e988069aa1a8e78d584, user_id=1543a3e8609048d9b03b10aebf656fe6, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.638430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.794731 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1164/2337] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:18 2022] PUT /identity/v3/projects/06acb283273b4e988069aa1a8e78d584/users/1543a3e8609048d9b03b10aebf656fe6/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:18.805239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.805733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.805825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.822074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:18.835131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] MFA Rules not processed for user `1543a3e8609048d9b03b10aebf656fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:18.839407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:18.932227 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1174/2338] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:18.941315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.943315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.048182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f93bf4-9b8b-461b-86a2-d2e458bd6134 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:19.053068 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:19.053670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:19.054114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:19.054363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:19.064241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:19.065910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:19.077149 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1165/2339] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:19.122939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:19.328377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:19.329862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.401174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e3b38-ea5e-4bd1-ba79-aab04cb06529 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:19.405255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:19.405907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:19.406190 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:19.406470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:19.408249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.482489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:19.483995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2e90-26d4-4308-a4d9-abf6c1272198 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:19.494665 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1175/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:20.589422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:20.590973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:20.660453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d4f0-b2de-484b-8cef-032f235cc704 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:20.665395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:20.666234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:20.666533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:20.666865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] PATH_INFO: `/v3/users/04a4650ba74042c5954d9374c4bb1fec` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:20.668176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a4650ba74042c5954d9374c4bb1fec)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:20.671171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:20.770758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:20.947688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a4650ba74042c5954d9374c4bb1fec'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:20.966382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a4650ba74042c5954d9374c4bb1fec'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.095991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a4650ba74042c5954d9374c4bb1fec'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.096659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a4650ba74042c5954d9374c4bb1fec'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.112405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a4650ba74042c5954d9374c4bb1fec'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.128825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1166/2341] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:20 2022] DELETE /identity/v3/users/04a4650ba74042c5954d9374c4bb1fec => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:21.129697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:21.130212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:21.130295 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:21.162220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:21.164471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:21.258696 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1176/2342] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:21.278200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:21.279905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:21.313074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:21.385691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c06c-2e3f-44e5-a171-12e07e577483 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:21.391558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:21.392186 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:21.392842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:21.393129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:21.417751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:21.421217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:21.435245 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1167/2343] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:22.524447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:22.526077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:22.539317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76388-7b00-4933-95fe-9055ce9a3659 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:22.544897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:22.545348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:22.545734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:22.546217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] PATH_INFO: `/v3/projects/353873cbb26147b2b8be0d3ed43b7fa0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:22.547568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353873cbb26147b2b8be0d3ed43b7fa0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:22.549675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:22.764529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353873cbb26147b2b8be0d3ed43b7fa0', 'request_id': 'req-d25c072f-be7f-49a7-ac28-f17bda48df33'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.770962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353873cbb26147b2b8be0d3ed43b7fa0', 'request_id': 'req-d25c072f-be7f-49a7-ac28-f17bda48df33'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.782232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353873cbb26147b2b8be0d3ed43b7fa0', 'request_id': 'req-d25c072f-be7f-49a7-ac28-f17bda48df33'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.922687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] The token cache is being invalidate because project 353873cbb26147b2b8be0d3ed43b7fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:22.923340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.924221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.925945 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1177/2344] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:22 2022] DELETE /identity/v3/projects/353873cbb26147b2b8be0d3ed43b7fa0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:22.930302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:22.944865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0745-d3bd-40a1-b5b0-2321431f4e25 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:23.033632 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:23.034558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:23.035290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:23.035290 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] PATH_INFO: `/v3/users/a5e0f8f50a8b4632bb97b142c4ab3f62` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:23.036615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e0f8f50a8b4632bb97b142c4ab3f62)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:23.038640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:23.488082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e0f8f50a8b4632bb97b142c4ab3f62'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.513345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e0f8f50a8b4632bb97b142c4ab3f62'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.624584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e0f8f50a8b4632bb97b142c4ab3f62'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.625363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e0f8f50a8b4632bb97b142c4ab3f62'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.641721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e0f8f50a8b4632bb97b142c4ab3f62'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.650796 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1168/2345] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:22 2022] DELETE /identity/v3/users/a5e0f8f50a8b4632bb97b142c4ab3f62 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:23.963868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:24.297758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.299111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:24.338127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c072f-be7f-49a7-ac28-f17bda48df33 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.434381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.435035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.435317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.435611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] PATH_INFO: `/v3/projects/6ad819142f8848e5b6568c8c49989440` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.437624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad819142f8848e5b6568c8c49989440)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.439698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.576522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad819142f8848e5b6568c8c49989440', 'request_id': 'req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:24.587558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad819142f8848e5b6568c8c49989440', 'request_id': 'req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:24.595346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad819142f8848e5b6568c8c49989440', 'request_id': 'req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:24.791484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] The token cache is being invalidate because project 6ad819142f8848e5b6568c8c49989440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:24.791484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:24.791484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:24.791484 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1178/2346] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:24 2022] DELETE /identity/v3/projects/6ad819142f8848e5b6568c8c49989440 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:24.792075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.792075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:24.792075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874bc8-4a2b-48ca-b6fe-54df62842269 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.846111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.846742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.847024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.847298 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] PATH_INFO: `/v3/users/b7b575005a6d48b4b5430198f5279da2` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.848439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b575005a6d48b4b5430198f5279da2)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.850388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.113497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:25.265980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b575005a6d48b4b5430198f5279da2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:25.275194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b575005a6d48b4b5430198f5279da2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:25.430236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b575005a6d48b4b5430198f5279da2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:25.430999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b575005a6d48b4b5430198f5279da2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:25.448433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f72782ce-17e2-4e72-80d7-e6a3e7c41f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b575005a6d48b4b5430198f5279da2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:25.460169 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1169/2347] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:24 2022] DELETE /identity/v3/users/b7b575005a6d48b4b5430198f5279da2 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:26.296013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:26.297636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.314150 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7dac-6c6d-4480-a9b7-2e751f03122d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:26.378818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:26.379380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:26.379658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:26.379932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] PATH_INFO: `/v3/projects/5171c0a329a54bf8a71ce66906c472de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.381050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5171c0a329a54bf8a71ce66906c472de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:26.383016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:26.617968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5171c0a329a54bf8a71ce66906c472de', 'request_id': 'req-d84939b0-0b3f-48f4-87f5-7e139e974b31'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.624797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5171c0a329a54bf8a71ce66906c472de', 'request_id': 'req-d84939b0-0b3f-48f4-87f5-7e139e974b31'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.630904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5171c0a329a54bf8a71ce66906c472de', 'request_id': 'req-d84939b0-0b3f-48f4-87f5-7e139e974b31'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.930978 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] The token cache is being invalidate because project 5171c0a329a54bf8a71ce66906c472de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:26.931476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.932256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.934831 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1179/2348] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:26 2022] DELETE /identity/v3/projects/5171c0a329a54bf8a71ce66906c472de => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:28.142270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.879377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:30.861965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:31.698840 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.293707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.387838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.765628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:33.766024 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:33.766374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:33.810079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:33.811340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:33.869532 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1170/2349] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:33.912413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:33.913873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:33.983067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.987539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84939b0-0b3f-48f4-87f5-7e139e974b31 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:33.992489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:33.999832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:33.999832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:33.999832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:34.002234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:34.003824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cd3fb-602a-4304-ac0e-d1df1b6ff00e service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:34.011745 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1180/2350] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:20:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:34.316970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:34.991045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:35.816588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:35.944672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:35.946282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.017027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5fba-da7d-4cd3-b9a0-dfe26c6c44e8 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:36.021574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:36.022244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.022532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.022806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] PATH_INFO: `/v3/users/1543a3e8609048d9b03b10aebf656fe6` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.023946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1543a3e8609048d9b03b10aebf656fe6)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:36.025892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:36.361587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1543a3e8609048d9b03b10aebf656fe6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.369296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1543a3e8609048d9b03b10aebf656fe6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.499788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1543a3e8609048d9b03b10aebf656fe6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.500425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1543a3e8609048d9b03b10aebf656fe6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.514471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1543a3e8609048d9b03b10aebf656fe6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.521248 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1171/2351] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:35 2022] DELETE /identity/v3/users/1543a3e8609048d9b03b10aebf656fe6 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:36.526755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.527336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.527336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.554459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:36.555706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.638627 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1181/2352] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:36.662293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:36.665264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.770292 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc6eb-e00d-48d5-8384-64215532315f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:36.775563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:36.780148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.780509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.781446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.804814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:36.806552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3bc7-076b-411c-9574-b551bf7e0421 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:36.819163 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1172/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:37.157131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:37.363771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:37.365667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:37.391294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f55d8c-7155-4fcf-bbf7-fa361a8d78e5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.404757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.405414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.405700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.406010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] PATH_INFO: `/v3/projects/06acb283273b4e988069aa1a8e78d584` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.408487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06acb283273b4e988069aa1a8e78d584)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.421895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.644391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06acb283273b4e988069aa1a8e78d584', 'request_id': 'req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:37.651360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06acb283273b4e988069aa1a8e78d584', 'request_id': 'req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:37.659695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06acb283273b4e988069aa1a8e78d584', 'request_id': 'req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:37.853674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] The token cache is being invalidate because project 06acb283273b4e988069aa1a8e78d584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:37.854079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:37.855283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f9e6d8fc-6e3a-4032-8cf7-f93002511b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:37.858439 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1182/2354] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:37 2022] DELETE /identity/v3/projects/06acb283273b4e988069aa1a8e78d584 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:38.214254 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:40.107672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:45.423471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:45.424076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:45.424076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:45.456883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] MFA Rules not processed for user `75266a74abbb4129bac206a7d5944466`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:45.468432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:45.526135 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1173/2355] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:49.890293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:52.888964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214bfc-791b-4eee-be2e-08bf863e7452 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:52.888964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214bfc-791b-4eee-be2e-08bf863e7452 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:52.889550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214bfc-791b-4eee-be2e-08bf863e7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:52.911956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-87214bfc-791b-4eee-be2e-08bf863e7452 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:52.913298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-87214bfc-791b-4eee-be2e-08bf863e7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:52.991247 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1183/2356] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:53.000821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:53.003218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:53.094762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfcd16-485a-40a0-a1a1-5391430fde75 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:53.100764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:53.101595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:53.102241 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:53.102665 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:53.123264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:53.125599 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982fdb5-78b6-437b-980b-f53ddd391386 service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:53.147484 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1174/2357] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:20:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:56.861509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:56.862447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:56.862892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:56.864886 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1184/2358] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:56.872995 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfd21-1165-4b80-8010-fb0929857fdb None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:56.873942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfd21-1165-4b80-8010-fb0929857fdb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:56.874386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfd21-1165-4b80-8010-fb0929857fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:56.910078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2dfcfd21-1165-4b80-8010-fb0929857fdb None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:56.911847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2dfcfd21-1165-4b80-8010-fb0929857fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:56.949453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:56.997822 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1175/2359] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:57.009580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:57.014556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:57.087302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f209-76ab-47b9-bb9c-fba90468692f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:57.094726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:57.095585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.096031 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.096454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.108262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:57.109720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd80187-5dee-4df3-b109-8f808a77a4e3 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:57.123153 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1185/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:57.405297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.405714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.406090 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] PATH_INFO: `/` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.408426 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1176/2361] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:57.415834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54e33-ea2c-4d3e-b1b1-9f565ef4fdec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.416175 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54e33-ea2c-4d3e-b1b1-9f565ef4fdec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.416634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54e33-ea2c-4d3e-b1b1-9f565ef4fdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.442892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-07f54e33-ea2c-4d3e-b1b1-9f565ef4fdec None None] MFA Rules not processed for user `c6ee4ba08ab84302b567df30df796e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:57.444101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-07f54e33-ea2c-4d3e-b1b1-9f565ef4fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:57.514106 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1186/2362] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:57.530880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:57.532823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:57.547019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b271-6fe7-44a7-8152-b4da435ddb92 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:57.550897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:57.551450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.551792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.551991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.561395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:57.562974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fae22-5da5-4bdb-80ba-cfb2a4c4bfb9 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:57.571664 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1177/2363] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:57.661589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1516c4-d89d-4c05-8794-ec0a24cb918d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.662246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1516c4-d89d-4c05-8794-ec0a24cb918d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.665246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1516c4-d89d-4c05-8794-ec0a24cb918d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.665246 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1187/2364] 10.222.0.36 () {54 vars in 921 bytes} [Sun Aug 7 01:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:57.672061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7f4e-109b-40d9-ae7d-59f4c201e997 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.672359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7f4e-109b-40d9-ae7d-59f4c201e997 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.672890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7f4e-109b-40d9-ae7d-59f4c201e997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.696509 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-86cc7f4e-109b-40d9-ae7d-59f4c201e997 None None] MFA Rules not processed for user `f7e1030a5d0842f4b949a37a42ff753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:57.697881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-86cc7f4e-109b-40d9-ae7d-59f4c201e997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:57.716639 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1178/2365] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Aug 7 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:57.724697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1516c4-d89d-4c05-8794-ec0a24cb918d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:57.740883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1516c4-d89d-4c05-8794-ec0a24cb918d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:57.745046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:57.745776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:57.746072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:57.746997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:57.759881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:57.761633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:57.775793 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1188/2366] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:05.354494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1b5b-9998-47f3-b4c7-010c7ba8b883 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:05.355087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1b5b-9998-47f3-b4c7-010c7ba8b883 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:05.355087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1b5b-9998-47f3-b4c7-010c7ba8b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:05.384359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3aae1b5b-9998-47f3-b4c7-010c7ba8b883 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:05.386236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3aae1b5b-9998-47f3-b4c7-010c7ba8b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:05.402066 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1179/2367] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:05.416308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:05.432446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbd8e-9c60-4347-ae51-b4a1c3048f39 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:05.440273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:05.441208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:05.441591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:05.442028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:05.482239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:05.483187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:05.494084 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1189/2368] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:21:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:12.002457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:12.003016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:12.003016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:12.023910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:12.025147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:12.032318 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1180/2369] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:12.045202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:12.055815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cd42f-4e38-404c-9f59-63926472d8ed service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:12.061864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:12.062538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:12.062882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:12.063221 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:12.071736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:12.073375 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:12.082538 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1190/2370] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:17.092604 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:17.095395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:17.164039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2365a-596b-49f2-a87c-a23e60d29dbb None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:17.169019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:17.169719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:17.170038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:17.170315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] PATH_INFO: `/v3/users/cefeb892ad9e4f219d3b7129efe4a994` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:17.171503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefeb892ad9e4f219d3b7129efe4a994)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:17.174023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:17.497592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefeb892ad9e4f219d3b7129efe4a994'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:17.510162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefeb892ad9e4f219d3b7129efe4a994'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:17.617422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefeb892ad9e4f219d3b7129efe4a994'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:17.618077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefeb892ad9e4f219d3b7129efe4a994'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:17.631154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-f8eac6a9-87ea-426f-8bae-3d00272d0708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefeb892ad9e4f219d3b7129efe4a994'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:17.637563 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1181/2371] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:17 2022] DELETE /identity/v3/users/cefeb892ad9e4f219d3b7129efe4a994 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:18.003995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:18.029270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789f120-4a47-4177-89fb-9ab8589a540c service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:18.047849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:18.100254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:18.100934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:18.101415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:18.101948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] PATH_INFO: `/v3/projects/da03f1b485f44bd682faa9ef77a3557c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:18.103540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da03f1b485f44bd682faa9ef77a3557c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:18.106085 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:18.222112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da03f1b485f44bd682faa9ef77a3557c', 'request_id': 'req-10e6b54d-9472-433e-91a1-c4585d8b444e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:18.227447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da03f1b485f44bd682faa9ef77a3557c', 'request_id': 'req-10e6b54d-9472-433e-91a1-c4585d8b444e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:18.235692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da03f1b485f44bd682faa9ef77a3557c', 'request_id': 'req-10e6b54d-9472-433e-91a1-c4585d8b444e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:18.408995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] The token cache is being invalidate because project da03f1b485f44bd682faa9ef77a3557c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:18.409294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:18.409989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:18.417768 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1191/2372] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:18 2022] DELETE /identity/v3/projects/da03f1b485f44bd682faa9ef77a3557c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:27.633513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:28.406164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:34.369553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:34.370040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:34.370128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:34.390279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:34.391548 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:34.446244 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1182/2373] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:34.468739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:34.470173 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:34.539170 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b54d-9472-433e-91a1-c4585d8b444e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:34.544181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:34.544775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:34.545054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:34.545325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:34.553133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:34.554824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:34.563040 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1192/2374] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:44.439401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=25 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:44.560055 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=32 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:55.295601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:55.297126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:55.358865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b271-b557-45b4-93cb-6df1483d091c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:55.362625 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:55.363235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:55.363525 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:55.363819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:55.365616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:55.438708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:55.440156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:55.451946 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1183/2375] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:56.635550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:56.636936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:56.649258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33841bd6-7565-4dd8-b1ab-dc4c4f09c31f service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:56.652944 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:56.653539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:56.653824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:56.654122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:56.655798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:56.668849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:56.670412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:56.681144 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1193/2376] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:05.446163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=54 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:06.676342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:11.269943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:11.271333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:11.327435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e584-6630-44f4-ba24-8bb808165c39 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:11.331342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:11.331947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:11.332232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:11.332511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:11.334308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:11.393150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:11.394611 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:11.403860 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1184/2377] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:21.399256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=48 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:24.172542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:24.180996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bafc2-38c3-4e86-a352-0cffaa797a93 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:24.185465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:24.186095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:24.186377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:24.186649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:24.188419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:24.198771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:24.200793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:24.208758 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1194/2378] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:34.205047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:45.230002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:45.231124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:45.247491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45ecc-0320-482c-8703-eb5a995d66e1 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:45.252876 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:45.253467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:45.253744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:45.254049 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:45.255701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:45.441178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:45.442943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84449-bf6a-4eee-8ae1-4fc2adbcd330 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:45.452275 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1185/2379] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:51.621979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:51.623560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:51.640224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d162a-26de-459f-9478-e24cc54744c0 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:51.645990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:51.646695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:51.646975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:51.647249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:51.649045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:51.662501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:51.663955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:51.675466 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1195/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:55.447651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=28 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:57.234324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:57.234926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:57.234926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:57.253947 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] MFA Rules not processed for user `598402f6609c422cbcc0dd0bfae53430`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:57.257460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:57.262061 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1186/2381] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:57.592670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:57.601924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bad5-9d29-4221-9e63-df364af5c3b5 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:57.605425 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:57.606036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:57.606314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:57.606585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:57.608573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:57.618115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:57.619560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead3867-aac0-4614-877c-029047282e5d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:57.627735 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1196/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:58.029108 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:58.030549 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:58.108805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209832c-1e0a-4617-83a1-3b944cc3d09e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:58.116195 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:58.116806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:58.117084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:58.117355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:58.119097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:58.131882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:58.133467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:58.143515 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1187/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:59.407804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:59.409854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:59.409854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:59.427692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] MFA Rules not processed for user `75266a74abbb4129bac206a7d5944466`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:59.429029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:59.483064 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1197/2384] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:06.106652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:06.121096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeadd5-d8c9-47d8-9fbc-062afe92054a service placement] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:06.127750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:06.128359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:06.128644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:06.128917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:06.130790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:06.144942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:06.146559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cc854-1969-450e-9f61-f1fe7bba878b service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:06.158159 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1188/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:09.476494 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=37 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:11.347744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:11.361270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d03933-d8af-4105-8443-7661d292bce8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:11.366678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:11.367302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:11.367625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:11.367852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:11.369571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:11.381595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:11.383211 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:11.393484 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1198/2386] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:16.153619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=41 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:21.389562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:27.909952 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:27.910425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:27.910532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:27.929229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:27.930435 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:27.938280 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1189/2387] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:28.099581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:28.110838 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d65d-999f-4951-86db-35ce18542fb7 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:28.115999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:28.116587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:28.116867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:28.117140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:28.125335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:28.126977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:28.135254 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1199/2388] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:33.287357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:33.299159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7a18f-58c5-4403-9883-21295c566e91 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:33.304216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:33.304850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:33.305130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:33.305410 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:33.307217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:33.320025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:33.321624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:33.333209 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1190/2389] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:37.532622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.535626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.552957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f730f-30df-45f6-80eb-82824332d3f3 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:37.558777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:37.559595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.560753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.561401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.563445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.580524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:37.581641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:37.593550 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1200/2390] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:37.750533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.751925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.852500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668f74-ae7f-46f3-886a-9764f28286b8 service placement] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:37.858738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:37.859745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.860256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.860753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] PATH_INFO: `/v3/users/b278dc86c8bb4ee5abd24074c8450189` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.862412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b278dc86c8bb4ee5abd24074c8450189)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:37.865197 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.130527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b278dc86c8bb4ee5abd24074c8450189'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.140803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b278dc86c8bb4ee5abd24074c8450189'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.269986 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b278dc86c8bb4ee5abd24074c8450189'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.270685 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b278dc86c8bb4ee5abd24074c8450189'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.284403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b278dc86c8bb4ee5abd24074c8450189'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.290322 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1191/2391] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:37 2022] DELETE /identity/v3/users/b278dc86c8bb4ee5abd24074c8450189 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:38.571228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.587376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56961ab-196f-4252-a2a3-5a500b5ec435 service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.651445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.652169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.652520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.652870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] PATH_INFO: `/v3/projects/da141dca2d874d4bbb679cde1a089b7a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.654710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da141dca2d874d4bbb679cde1a089b7a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.656701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.784249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da141dca2d874d4bbb679cde1a089b7a', 'request_id': 'req-036a0171-ae77-4945-9811-16da3dd2d7b8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.791651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da141dca2d874d4bbb679cde1a089b7a', 'request_id': 'req-036a0171-ae77-4945-9811-16da3dd2d7b8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.802681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da141dca2d874d4bbb679cde1a089b7a', 'request_id': 'req-036a0171-ae77-4945-9811-16da3dd2d7b8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.900012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] The token cache is being invalidate because project da141dca2d874d4bbb679cde1a089b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:38.900302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.903588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:38.903588 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1201/2392] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:38 2022] DELETE /identity/v3/projects/da141dca2d874d4bbb679cde1a089b7a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:38.907515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.908987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:38.921954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a08f-3fee-4e4a-b7dc-5a4977529443 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.984962 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.985934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.985934 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.986215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] PATH_INFO: `/v3/users/a556af096e4e42a0a8d10be1bcfe54af` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.987381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a556af096e4e42a0a8d10be1bcfe54af)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.989420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.991153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.262256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a556af096e4e42a0a8d10be1bcfe54af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.269802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a556af096e4e42a0a8d10be1bcfe54af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.352326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a556af096e4e42a0a8d10be1bcfe54af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.352943 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a556af096e4e42a0a8d10be1bcfe54af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.366107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-664b42f5-9cf4-428d-a321-e6c2c91fdb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a556af096e4e42a0a8d10be1bcfe54af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.372075 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1192/2393] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:38 2022] DELETE /identity/v3/users/a556af096e4e42a0a8d10be1bcfe54af => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:39.706865 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.708750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:39.722423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0171-ae77-4945-9811-16da3dd2d7b8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.780644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.781271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.781550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.781822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] PATH_INFO: `/v3/projects/8cd2ed65409a4ca8a95b019f4c114735` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.782964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd2ed65409a4ca8a95b019f4c114735)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.784887 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.795653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.911511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd2ed65409a4ca8a95b019f4c114735', 'request_id': 'req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.917028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd2ed65409a4ca8a95b019f4c114735', 'request_id': 'req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.923963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd2ed65409a4ca8a95b019f4c114735', 'request_id': 'req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.032613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] The token cache is being invalidate because project 8cd2ed65409a4ca8a95b019f4c114735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:40.032931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.033692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.035262 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1202/2394] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:39 2022] DELETE /identity/v3/projects/8cd2ed65409a4ca8a95b019f4c114735 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:42.999073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.999608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.999735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.019196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] MFA Rules not processed for user `4c8389683e844b989fe5cbe779327933`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:43.020392 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:43.075982 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1193/2395] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:43.390694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.392088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:43.448799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f91cb-ff7a-4e52-bc62-c01ea4d8acde admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.452451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.453039 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.453318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.453633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.455363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:43.464873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.466326 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.474688 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1203/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:45.413468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.415451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:45.477129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8923a-7ee0-4436-af6f-8c085f329d84 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:45.480801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:45.481338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.481613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.481954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.483808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:45.484358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.485718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:45.525600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:45.545745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:45.547198 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:45.556226 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1194/2397] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:45.563339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bc521-85fa-42c1-85f6-bf605bb88bfd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:45.569076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:45.569686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.570007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.570293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.579372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:45.580996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:45.590491 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1204/2398] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:55.586333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:55.704147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=10 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:12.481695 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.483174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:12.494584 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790083d5-bde7-46f7-84cb-b25435dbb83d service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.498113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.498693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.498978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.499242 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.501517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:12.559069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.560533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.570464 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1195/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:22.566459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=28 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:35.347283 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.356548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eface5ca-142b-4236-8177-4c4a6c6ca6d5 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.360054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.361276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.361652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.361982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.363671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:35.425957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.427392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.436797 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1205/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:39.097191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:39.097191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:39.111279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f19f5-1c01-431b-94dd-608ac68a326e service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:39.115976 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:39.116597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:39.116880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:39.117159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] PATH_INFO: `/v3/users/75266a74abbb4129bac206a7d5944466` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:39.118304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75266a74abbb4129bac206a7d5944466)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:39.120218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:39.326153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75266a74abbb4129bac206a7d5944466'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.334521 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75266a74abbb4129bac206a7d5944466'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.420162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75266a74abbb4129bac206a7d5944466'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.420887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75266a74abbb4129bac206a7d5944466'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.433359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-29a7472e-1c72-45a0-be7d-b55a89bd4a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75266a74abbb4129bac206a7d5944466'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.439694 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1196/2401] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:39 2022] DELETE /identity/v3/users/75266a74abbb4129bac206a7d5944466 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:39.691014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:39.701817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d651-74a9-48bc-b104-7ad9ce997008 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:39.759444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:39.760177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:39.760503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:39.760782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] PATH_INFO: `/v3/projects/32cc230c70b341fca95fa1b962d73909` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:39.762004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32cc230c70b341fca95fa1b962d73909)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:39.764207 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:39.906786 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32cc230c70b341fca95fa1b962d73909', 'request_id': 'req-a63200e8-1275-4018-820f-33ea57709cd3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.912377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32cc230c70b341fca95fa1b962d73909', 'request_id': 'req-a63200e8-1275-4018-820f-33ea57709cd3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.918574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32cc230c70b341fca95fa1b962d73909', 'request_id': 'req-a63200e8-1275-4018-820f-33ea57709cd3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.992364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] The token cache is being invalidate because project 32cc230c70b341fca95fa1b962d73909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:39.992660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.993276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a63200e8-1275-4018-820f-33ea57709cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:39.995024 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1206/2402] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:39 2022] DELETE /identity/v3/projects/32cc230c70b341fca95fa1b962d73909 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:39.999747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.000038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.000320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.020087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:40.021283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:40.079742 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1197/2403] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:40.087760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.088047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.088321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.107672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:40.108862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:40.117743 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1207/2404] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:40.122123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.131799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1288d-2632-41c3-b136-87725da8b192 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.136275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.136861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.137140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.137412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.138080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:40.138386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.139994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.151188 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1198/2405] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:40.155346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.165266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8db3c-3f82-451f-bf4c-462465927904 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.175981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.176595 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.176876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.177151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.177797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.179806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.195497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:40.335433 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1208/2406] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:40.339563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.349949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9345d-990b-4e78-afbd-2371f01c544b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.404807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.405395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.405679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.406054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.406613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.409147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.416971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:40.534113 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1199/2407] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:40.538232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.548520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a7ad-d114-47d3-b7ac-b6e55782bc6f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.553028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.553622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.553941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.554220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.554859 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.556460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.566354 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1209/2408] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:40.570310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.580795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf9d2-9ad4-4a84-a884-e807c8a86303 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.585666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.586255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.586536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.586809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.587442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.589007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1586d9-7da4-4ab6-9680-32c639901d76 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.600046 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1200/2409] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:40.604094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.614088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc5fb-861f-45f8-969f-068d7c344e33 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.618613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.619249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.619531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.619811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] PATH_INFO: `/v3/projects/33a47f3e04404e6f80514a5ce6d59d41/users/3d237ed43f9f468d92f0e7aeef296923/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.634424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a47f3e04404e6f80514a5ce6d59d41, user_id=3d237ed43f9f468d92f0e7aeef296923, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.646231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.798797 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1210/2410] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:40 2022] PUT /identity/v3/projects/33a47f3e04404e6f80514a5ce6d59d41/users/3d237ed43f9f468d92f0e7aeef296923/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:40.810073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.810366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.812295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.842157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] MFA Rules not processed for user `3d237ed43f9f468d92f0e7aeef296923`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:40.843375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:40.905449 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1201/2411] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:40.910318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.971277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538cd66-aeb3-4ac6-a96b-077e5dff76f8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.975885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.976496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.976770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.977041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.977735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.979699 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.088922 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1211/2412] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:41.093222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.104184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfcd9-4344-41ce-a0c1-fc22d24cbad4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.164786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.165477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.165671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.165984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.166624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.168550 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.282182 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1202/2413] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:41 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:41.286063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.296240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313fb0-c23c-4aca-b560-dbd07616d8dd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.301883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.302753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.303034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.303306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.303948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.305583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.316886 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1212/2414] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:41.321034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.331347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127eb40-17ef-4cf5-9985-c3f260e3549e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.336272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.336918 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.337201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.337529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] PATH_INFO: `/v3/projects/4f1897bda6514ab7a807ff6015bcbf50/users/d553d9ecd1034b47baca2582c5843440/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.352331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1897bda6514ab7a807ff6015bcbf50, user_id=d553d9ecd1034b47baca2582c5843440, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.355092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.495353 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1203/2415] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:41 2022] PUT /identity/v3/projects/4f1897bda6514ab7a807ff6015bcbf50/users/d553d9ecd1034b47baca2582c5843440/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:41.499392 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.510128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad40cc-a95d-405e-a68c-effd9805dfc3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.566393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.566918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.567202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.567484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.568115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.569716 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb56912-c73a-4a02-9196-e745092f0eb6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.579962 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1213/2416] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:41.584422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.594682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e837-525c-4d71-be15-70d2fd6eaf62 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.599464 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.600114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.600393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.600668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] PATH_INFO: `/v3/projects/4f1897bda6514ab7a807ff6015bcbf50/users/d553d9ecd1034b47baca2582c5843440/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.602587 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1897bda6514ab7a807ff6015bcbf50, user_id=d553d9ecd1034b47baca2582c5843440, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.605230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.615969 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1204/2417] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:41 2022] PUT /identity/v3/projects/4f1897bda6514ab7a807ff6015bcbf50/users/d553d9ecd1034b47baca2582c5843440/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:41.626809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.627092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.627393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.654353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] MFA Rules not processed for user `d553d9ecd1034b47baca2582c5843440`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:41.655558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:41.673746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:41.722615 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1214/2418] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:41.733874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.736173 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:41.759717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:41.792925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058970-2670-49d1-acdf-79306c509389 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.796689 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.797321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.798432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.799153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.808235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.809706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5870af-0e0a-49dd-a262-170c16d8eee6 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:41.819913 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1205/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:41.887228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.950357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058c5ed-ea51-4932-9abd-f3839750a5ce None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.954922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.955552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.955833 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.956107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] PATH_INFO: `/v3/users/3d237ed43f9f468d92f0e7aeef296923` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.957245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d237ed43f9f468d92f0e7aeef296923)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:41.959484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:42.228363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d237ed43f9f468d92f0e7aeef296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.317508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d237ed43f9f468d92f0e7aeef296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.324756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d237ed43f9f468d92f0e7aeef296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.325379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d237ed43f9f468d92f0e7aeef296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.338230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d237ed43f9f468d92f0e7aeef296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.344043 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1215/2420] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:41 2022] DELETE /identity/v3/users/3d237ed43f9f468d92f0e7aeef296923 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:42.349304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:42.349772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:42.349918 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:42.368343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:42.370992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:42.428388 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1206/2421] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:42.438137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:42.439546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:42.479948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:42.496799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad2a47-3380-4fa5-b2ee-8b33022e9d54 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:42.500504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:42.501240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:42.501583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:42.501895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:42.510667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:42.512091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:42.521922 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1216/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:43.027940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:43.029305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:43.043086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932ac4-0df9-4474-94e5-f9a59df84f82 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:43.048354 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:43.050505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:43.050505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:43.050505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] PATH_INFO: `/v3/projects/33a47f3e04404e6f80514a5ce6d59d41` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:43.050821 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a47f3e04404e6f80514a5ce6d59d41)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:43.052647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:43.206443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a47f3e04404e6f80514a5ce6d59d41', 'request_id': 'req-6023bc76-f35f-4a10-8937-f165905d7847'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.206443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a47f3e04404e6f80514a5ce6d59d41', 'request_id': 'req-6023bc76-f35f-4a10-8937-f165905d7847'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.207512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a47f3e04404e6f80514a5ce6d59d41', 'request_id': 'req-6023bc76-f35f-4a10-8937-f165905d7847'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.309430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] The token cache is being invalidate because project 33a47f3e04404e6f80514a5ce6d59d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:43.309676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.310325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.311806 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1207/2423] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:43 2022] DELETE /identity/v3/projects/33a47f3e04404e6f80514a5ce6d59d41 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:43.316713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:43.326457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962c282-713b-42f2-85cd-abf640c005e7 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:43.382203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:43.382834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:43.383119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:43.383397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] PATH_INFO: `/v3/users/d553d9ecd1034b47baca2582c5843440` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:43.384548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d553d9ecd1034b47baca2582c5843440)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:43.386580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:43.620857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd553d9ecd1034b47baca2582c5843440'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.706276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd553d9ecd1034b47baca2582c5843440'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.713805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd553d9ecd1034b47baca2582c5843440'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.714465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd553d9ecd1034b47baca2582c5843440'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.726613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-becf67fc-c653-4b96-98ba-2bced3fb65e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd553d9ecd1034b47baca2582c5843440'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.732411 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1217/2424] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:43 2022] DELETE /identity/v3/users/d553d9ecd1034b47baca2582c5843440 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:44.199205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:44.204155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:44.214113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc76-f35f-4a10-8937-f165905d7847 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:44.259127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:44.271441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:44.272912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.272912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.272912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] PATH_INFO: `/v3/projects/4f1897bda6514ab7a807ff6015bcbf50` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.273908 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1897bda6514ab7a807ff6015bcbf50)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:44.275808 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:44.431973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1897bda6514ab7a807ff6015bcbf50', 'request_id': 'req-c9b6edf7-32db-4842-95e0-864175d776f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.437653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1897bda6514ab7a807ff6015bcbf50', 'request_id': 'req-c9b6edf7-32db-4842-95e0-864175d776f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.444190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1897bda6514ab7a807ff6015bcbf50', 'request_id': 'req-c9b6edf7-32db-4842-95e0-864175d776f3'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.545457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] The token cache is being invalidate because project 4f1897bda6514ab7a807ff6015bcbf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:44.545680 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.546330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c9b6edf7-32db-4842-95e0-864175d776f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.547940 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1208/2425] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:44 2022] DELETE /identity/v3/projects/4f1897bda6514ab7a807ff6015bcbf50 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:44.552918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.557404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.557404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.572531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:44.573758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:44.622122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:44.631562 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1218/2426] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:44.639420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.639717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.639992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.660640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:44.661899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:44.669767 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1209/2427] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:44.674124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:44.683689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d171a8-77d6-40a5-a683-892565d7ddf5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:44.688799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:44.689411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.689702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.690010 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.690661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:44.690972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:44.692574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:44.704439 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1219/2428] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:24:44.708805 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:44.718237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ced391-d1f1-411c-90d1-13488b838fa6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:44.723402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:44.723988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.724270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.724543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.725188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:44.727118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:44.888504 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1210/2429] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:44.892839 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:44.902747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412d8f-80c5-496a-ae97-6d34e5919438 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:44.957918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:44.958518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.958801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.959384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.960006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:44.962006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.106838 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1220/2430] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:45.111722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.122449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97274-5c94-47e0-9de5-7945832d6143 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.127809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.128848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.129321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.129851 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.131038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.133762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.147684 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1211/2431] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:45.149515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.160186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73dd5-fcd5-44f9-b547-e0e554d56a92 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.164814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.165412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.165695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.166013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.166662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.171075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61460-326a-43a0-ad73-77260e01299a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.179596 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1221/2432] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:45.183818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.194061 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fafe9a-5683-4905-bb2d-aa2de4385249 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.198536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.199176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.199457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.199984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] PATH_INFO: `/v3/projects/49cb682053554eb49cb336ab99eb2dda/users/baf1d1601c15407e849e0b7b9d0e79a4/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.214496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cb682053554eb49cb336ab99eb2dda, user_id=baf1d1601c15407e849e0b7b9d0e79a4, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.217151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.306176 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1212/2433] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:45 2022] PUT /identity/v3/projects/49cb682053554eb49cb336ab99eb2dda/users/baf1d1601c15407e849e0b7b9d0e79a4/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:45.317919 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.318252 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.318548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.348658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] MFA Rules not processed for user `baf1d1601c15407e849e0b7b9d0e79a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:45.349917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:45.414493 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1222/2434] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:45.419044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.482191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b925d-b738-4c9e-a8d4-05fd3ae1b72c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.487598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.488206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.488489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.488768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.489408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.491407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.632347 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:45.639455 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1213/2435] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:45 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:45.643763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.654404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4e96-ea2d-4f9a-9af6-b0df5a3a5c63 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.700917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:45.709701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.715942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.715942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.715942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.715942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.715942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.815175 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1223/2436] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:45 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:45.819245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.829271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d8141-cd7c-42fc-8e71-afd5f5ed5b11 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.834463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.835062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.835349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.835630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.836330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.837960 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.849041 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1214/2437] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:45.852993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.863561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d1d9d-6646-4d8a-92ee-fbf03f415831 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.867990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.868583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.868863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.870548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.870548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.871418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59e81e-7592-46ab-a78a-21d2dc2358d8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.881720 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1224/2438] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:45.885688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.895699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223416d-98d1-4641-bc7e-662a311ba75f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.900369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.905251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.905251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.905251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] PATH_INFO: `/v3/projects/a19a5ea1d8d8475eb37fe8913f10ca28/users/70bc3f5fc03a4af5919f8d432bf2e35b/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.917262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19a5ea1d8d8475eb37fe8913f10ca28, user_id=70bc3f5fc03a4af5919f8d432bf2e35b, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.919956 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.007509 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1215/2439] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:45 2022] PUT /identity/v3/projects/a19a5ea1d8d8475eb37fe8913f10ca28/users/70bc3f5fc03a4af5919f8d432bf2e35b/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:46.018486 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.019100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.019599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.047035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] MFA Rules not processed for user `70bc3f5fc03a4af5919f8d432bf2e35b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:46.048230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:46.111357 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1225/2440] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:46.116064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.177922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63271ad2-ca32-4088-89e7-ad162e95a97f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.182457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.183052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.183337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.183610 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.184229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.186196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.299897 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1216/2441] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:46 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:46.304064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.314909 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb09a7-9f2f-4b43-a726-d5a3126c97b7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.369651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.370275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.370557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.370831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.371455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.373374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.477720 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1226/2442] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:46 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:46.481708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.492760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8bbaa-ecf3-4b06-89b8-28d1d2843637 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.497301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.499871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.499871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.499871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.499871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.500751 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.511141 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1217/2443] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:46.515372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.525356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45139b1-bc47-4a6b-a2f7-bad2cb3783f7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.529930 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.530574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.530854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.531130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] PATH_INFO: `/v3/projects/a0964d3b5603495b92cb34ac0979973a/users/0c5e1ac85bfd475bbfa9f68c3e7c3358/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.545926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0964d3b5603495b92cb34ac0979973a, user_id=0c5e1ac85bfd475bbfa9f68c3e7c3358, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.549287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.661803 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1227/2444] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:46 2022] PUT /identity/v3/projects/a0964d3b5603495b92cb34ac0979973a/users/0c5e1ac85bfd475bbfa9f68c3e7c3358/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:46.666218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.677089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2133aae-b55a-426f-98b8-94a50ace0734 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.735997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.736605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.737021 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.737422 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.738015 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.739617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845952d-91fd-4ac6-8187-24e7303b1a20 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.749893 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1218/2445] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:46.754042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.764796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b2a3-4af7-41c1-8ef5-f0a675a17f1d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.770254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.771575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.771575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.771575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] PATH_INFO: `/v3/projects/a0964d3b5603495b92cb34ac0979973a/users/0c5e1ac85bfd475bbfa9f68c3e7c3358/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.773885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0964d3b5603495b92cb34ac0979973a, user_id=0c5e1ac85bfd475bbfa9f68c3e7c3358, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.776535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.787560 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1228/2446] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:46 2022] PUT /identity/v3/projects/a0964d3b5603495b92cb34ac0979973a/users/0c5e1ac85bfd475bbfa9f68c3e7c3358/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:46.798833 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.799117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.799395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.826433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] MFA Rules not processed for user `0c5e1ac85bfd475bbfa9f68c3e7c3358`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:46.827638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:46.849326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:46.897480 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1219/2447] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:46.908819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:46.910556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:46.925965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:46.967358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d1cec-28b7-47c8-8389-3051b4e1d11d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:46.970988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:46.971581 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:46.971913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:46.972154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.983306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:46.983306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:46.992787 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1229/2448] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:47.126819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:47.128216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.140226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394ee3d-b375-435a-af41-e338c903afe7 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:47.143823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:47.144456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.144740 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.145017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.206698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:47.208160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e4cbb-b4b0-41fe-8e23-48f6e88ac772 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:47.217384 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1220/2449] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:52.640799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:52.745352 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6145b5-9441-4f39-af83-ec90a7c34a20 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:52.750027 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:52.750686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:52.750967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:52.751242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] PATH_INFO: `/v3/users/baf1d1601c15407e849e0b7b9d0e79a4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:52.752373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf1d1601c15407e849e0b7b9d0e79a4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:52.754366 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:53.009430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf1d1601c15407e849e0b7b9d0e79a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.111766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf1d1601c15407e849e0b7b9d0e79a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.119033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf1d1601c15407e849e0b7b9d0e79a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.122860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf1d1601c15407e849e0b7b9d0e79a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.130578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:53.132707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf1d1601c15407e849e0b7b9d0e79a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.138430 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1230/2450] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:52 2022] DELETE /identity/v3/users/baf1d1601c15407e849e0b7b9d0e79a4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:53.142868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:53.143425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:53.143425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:53.191350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:53.193385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:53.250991 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1221/2451] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:53.261345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:53.262831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:53.334872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bafa-780a-4489-8b9c-7dcec3590c2f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:53.338932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:53.339531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:53.339811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:53.340086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:53.349102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:53.350566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:53.359838 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1231/2452] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:53.851244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:53.852699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:53.870126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5638c5-15d9-4c1d-8918-d93d63999bca None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:53.871827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:53.872462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:53.872743 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:53.873020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] PATH_INFO: `/v3/projects/49cb682053554eb49cb336ab99eb2dda` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:53.874958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cb682053554eb49cb336ab99eb2dda)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:53.876927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:53.976953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:53.994044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cb682053554eb49cb336ab99eb2dda', 'request_id': 'req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:53.999458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cb682053554eb49cb336ab99eb2dda', 'request_id': 'req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.005686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cb682053554eb49cb336ab99eb2dda', 'request_id': 'req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.091785 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] The token cache is being invalidate because project 49cb682053554eb49cb336ab99eb2dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:54.091972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.092551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.094048 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1222/2453] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:53 2022] DELETE /identity/v3/projects/49cb682053554eb49cb336ab99eb2dda => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:54.098761 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:54.108582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359905e-a7f8-465a-b625-9867309e7c8c service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:54.165278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:54.165931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:54.166213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:54.166487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] PATH_INFO: `/v3/users/70bc3f5fc03a4af5919f8d432bf2e35b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:54.167600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bc3f5fc03a4af5919f8d432bf2e35b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:54.169529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:54.365032 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bc3f5fc03a4af5919f8d432bf2e35b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.458917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bc3f5fc03a4af5919f8d432bf2e35b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.466168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bc3f5fc03a4af5919f8d432bf2e35b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.466791 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bc3f5fc03a4af5919f8d432bf2e35b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.478922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bc3f5fc03a4af5919f8d432bf2e35b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:54.481184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:54.485456 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1232/2454] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:54 2022] DELETE /identity/v3/users/70bc3f5fc03a4af5919f8d432bf2e35b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:54.998156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:54.999615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:55.015996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328319a6-cb78-42b7-b0d5-333ae0c3f6a4 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:55.074368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:55.074991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:55.075276 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:55.075553 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] PATH_INFO: `/v3/projects/a19a5ea1d8d8475eb37fe8913f10ca28` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:55.076672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19a5ea1d8d8475eb37fe8913f10ca28)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:55.078616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:55.219690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19a5ea1d8d8475eb37fe8913f10ca28', 'request_id': 'req-9230618f-77ab-4738-a375-d71ec9ffbe88'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.224958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19a5ea1d8d8475eb37fe8913f10ca28', 'request_id': 'req-9230618f-77ab-4738-a375-d71ec9ffbe88'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.231070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19a5ea1d8d8475eb37fe8913f10ca28', 'request_id': 'req-9230618f-77ab-4738-a375-d71ec9ffbe88'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.344661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] The token cache is being invalidate because project a19a5ea1d8d8475eb37fe8913f10ca28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:55.344961 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.345573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.347090 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1223/2455] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:54 2022] DELETE /identity/v3/projects/a19a5ea1d8d8475eb37fe8913f10ca28 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:55.351774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:55.353193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:55.366831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecf4fc-c809-4aa9-8855-090866c5cf73 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:55.421767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:55.422438 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:55.422721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:55.422999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] PATH_INFO: `/v3/users/0c5e1ac85bfd475bbfa9f68c3e7c3358` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:55.424141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5e1ac85bfd475bbfa9f68c3e7c3358)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:55.426204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:55.694986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5e1ac85bfd475bbfa9f68c3e7c3358'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.802991 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5e1ac85bfd475bbfa9f68c3e7c3358'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.810240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5e1ac85bfd475bbfa9f68c3e7c3358'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.810917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5e1ac85bfd475bbfa9f68c3e7c3358'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.822687 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51c90503-b02e-48de-8f1f-8025d7e32f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5e1ac85bfd475bbfa9f68c3e7c3358'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:55.828392 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1233/2456] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:55 2022] DELETE /identity/v3/users/0c5e1ac85bfd475bbfa9f68c3e7c3358 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:56.324728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:56.326275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:56.339694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230618f-77ab-4738-a375-d71ec9ffbe88 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:56.382630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:56.397853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:56.398488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.398769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.399075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] PATH_INFO: `/v3/projects/a0964d3b5603495b92cb34ac0979973a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.400544 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0964d3b5603495b92cb34ac0979973a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:56.402513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:56.597270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0964d3b5603495b92cb34ac0979973a', 'request_id': 'req-c3257ef8-ee69-44bc-a034-5548e6c83cac'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:56.602892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0964d3b5603495b92cb34ac0979973a', 'request_id': 'req-c3257ef8-ee69-44bc-a034-5548e6c83cac'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:56.609027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0964d3b5603495b92cb34ac0979973a', 'request_id': 'req-c3257ef8-ee69-44bc-a034-5548e6c83cac'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:56.740455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] The token cache is being invalidate because project a0964d3b5603495b92cb34ac0979973a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:56.740745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:56.741364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-c3257ef8-ee69-44bc-a034-5548e6c83cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:56.742864 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1224/2457] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:56 2022] DELETE /identity/v3/projects/a0964d3b5603495b92cb34ac0979973a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:56.748872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.749347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.749453 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.798239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:56.799441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:56.846793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:56.859457 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1234/2458] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:56.867538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.867823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.868129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.888518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:56.889749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:56.898600 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1225/2459] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:56.908219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:56.918356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd1b8-379e-4bb8-877b-c001c93668bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:56.922915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:56.923513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.923796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.924073 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.924715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:56.925023 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:56.926680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:56.939514 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1235/2460] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:56.944478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:56.953731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a090e4-8974-49a7-8d3b-865be1246b24 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:56.959017 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:56.959863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.960139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.960412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.961041 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:56.962993 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.091307 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1226/2461] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:56 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:57.095479 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.105734 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127112-4010-4df3-a2e6-6ebeb65f9752 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.160926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.161498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.161970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.162251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.162873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.164817 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.305628 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1236/2462] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:57 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:57.309622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.321330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578f0f1-a4e9-45c7-a7b3-c99c542dcf29 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.326146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.326849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.327141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.327417 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.328057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.329702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.340858 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1227/2463] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:57.344881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.355272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3393c-68e4-4448-806d-714c542b722b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.360313 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.360928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.361215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.361495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.362301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.363908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353a4b-77f9-4df8-91c9-b793969e089d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.376512 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1237/2464] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:57.380901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.391607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c36f2-f1e1-4c67-a67b-c14befc81ab5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.396227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.396871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.397153 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.397429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] PATH_INFO: `/v3/projects/03a17e3f60c9462385e8eb8949e715db/users/8390394e0d004723a6bcb0023953e55b/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.412001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a17e3f60c9462385e8eb8949e715db, user_id=8390394e0d004723a6bcb0023953e55b, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.414687 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.544821 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1228/2465] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:57 2022] PUT /identity/v3/projects/03a17e3f60c9462385e8eb8949e715db/users/8390394e0d004723a6bcb0023953e55b/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:57.557159 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.557476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.557779 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.586050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] MFA Rules not processed for user `8390394e0d004723a6bcb0023953e55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:57.587299 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:57.655151 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1238/2466] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:57.659678 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.721728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a168-4aa8-458d-8370-276b1418da58 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.727154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.727748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.728035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.728316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.728946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.730898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:57.748528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:57.957179 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1229/2467] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:57 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:57.962279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.981127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906911c-04ad-41b8-8df4-7ff2327ed9e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.037863 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:58.049305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.049949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.050236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.050511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.051216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.053751 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.245398 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1239/2468] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:57 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:58.246892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:58.258664 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701d70-1055-4d07-9b2f-cb0a67d967a0 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.263316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.263920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.264211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.264489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.265139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.266843 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.278627 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1230/2469] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:58.282898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:58.294162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0df68-4399-41a8-bc70-ba9ba1a49b21 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.299120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.299787 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.300074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.300346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] PATH_INFO: `/v3/projects/104ee75a74ed410094b97de1f1341105/users/46f08bd3d98345368bc9a470451fbab1/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.318575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104ee75a74ed410094b97de1f1341105, user_id=46f08bd3d98345368bc9a470451fbab1, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.321875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.471323 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1240/2470] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:58 2022] PUT /identity/v3/projects/104ee75a74ed410094b97de1f1341105/users/46f08bd3d98345368bc9a470451fbab1/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:58.476020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:58.487269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d880-5256-4f9a-92a3-214bdb969376 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.557369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.558095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.558448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.558794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.560202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.562389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468de64-876a-44a6-82cc-63427233b321 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.577595 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1231/2471] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:58.590516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:58.602174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1188380-349d-4038-bab0-06c289be71b4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.607891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.608626 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.608973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.609317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] PATH_INFO: `/v3/projects/104ee75a74ed410094b97de1f1341105/users/46f08bd3d98345368bc9a470451fbab1/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.611845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104ee75a74ed410094b97de1f1341105, user_id=46f08bd3d98345368bc9a470451fbab1, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.615496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.628330 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1241/2472] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:58 2022] PUT /identity/v3/projects/104ee75a74ed410094b97de1f1341105/users/46f08bd3d98345368bc9a470451fbab1/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:58.640266 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be538f6-8b91-476b-bea3-52758144256a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.640827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be538f6-8b91-476b-bea3-52758144256a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.641178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be538f6-8b91-476b-bea3-52758144256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.672483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-1be538f6-8b91-476b-bea3-52758144256a None None] MFA Rules not processed for user `46f08bd3d98345368bc9a470451fbab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:58.673998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1be538f6-8b91-476b-bea3-52758144256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:58.747425 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1232/2473] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:58.760916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:58.762707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:58.820973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3d10-9b30-449b-b5c3-e692d0c580b5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:58.824654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:58.825258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.825537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.825813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.834892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:58.836327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26056e1-fb4c-437b-af90-a5fa2fb34910 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.846146 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1242/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:59.159820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be538f6-8b91-476b-bea3-52758144256a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:59.170505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be538f6-8b91-476b-bea3-52758144256a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:59.174100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:59.174694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:59.174979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:59.175258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:59.234564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:59.236031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:59.246382 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1233/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:03.857042 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:03.857529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:03.857623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:03.890413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:03.891658 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:03.953958 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1243/2476] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:04.133721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:04.135190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:04.141777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:04.212019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c7036-d288-48e6-b436-d9fd821c1d20 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:04.217054 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:04.217659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:04.217977 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:04.218258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:04.228225 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:04.229825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47532-035e-41bd-bb26-03b2ab6d00fc service swift] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:04.237821 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1234/2477] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:08.207383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:08.249365 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:08.279524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4f5a7-e065-4e92-b2a9-59a077dbc8b4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:08.284386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:08.287393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:08.287393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:08.287393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] PATH_INFO: `/v3/users/8390394e0d004723a6bcb0023953e55b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:08.287393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8390394e0d004723a6bcb0023953e55b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:08.288781 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:08.574427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8390394e0d004723a6bcb0023953e55b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.711731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8390394e0d004723a6bcb0023953e55b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.726733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8390394e0d004723a6bcb0023953e55b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.727558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8390394e0d004723a6bcb0023953e55b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.812882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8390394e0d004723a6bcb0023953e55b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.834952 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1244/2478] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:08 2022] DELETE /identity/v3/users/8390394e0d004723a6bcb0023953e55b => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:08.839035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:08.839513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:08.839598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:08.884086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:08.885592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:08.970933 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1235/2479] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:08.986801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:08.988891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:09.151860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae7b5f-f739-472e-b071-2d42f30e860f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:09.157491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:09.160259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:09.160762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:09.162219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:09.185227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:09.191505 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:09.208523 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1245/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:09.760738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:09.762601 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:09.782765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a588e-c99e-42f0-9b6b-6968e015ecd8 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:09.792597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:09.793308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:09.793674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:09.794018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] PATH_INFO: `/v3/projects/03a17e3f60c9462385e8eb8949e715db` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:09.797488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a17e3f60c9462385e8eb8949e715db)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:09.800957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:09.946438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a17e3f60c9462385e8eb8949e715db', 'request_id': 'req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:09.952806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a17e3f60c9462385e8eb8949e715db', 'request_id': 'req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:09.960064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a17e3f60c9462385e8eb8949e715db', 'request_id': 'req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.060288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] The token cache is being invalidate because project 03a17e3f60c9462385e8eb8949e715db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:10.060529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.061272 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.063021 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1236/2481] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:09 2022] DELETE /identity/v3/projects/03a17e3f60c9462385e8eb8949e715db => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:10.067035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:10.078009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5ec4-74dd-40ed-9783-c6402300fb0e service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:10.117081 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.146847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:10.147700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:10.147987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:10.148271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] PATH_INFO: `/v3/users/46f08bd3d98345368bc9a470451fbab1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:10.149701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f08bd3d98345368bc9a470451fbab1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:10.151736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:10.402080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f08bd3d98345368bc9a470451fbab1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.625893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f08bd3d98345368bc9a470451fbab1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.634287 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f08bd3d98345368bc9a470451fbab1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.635649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f08bd3d98345368bc9a470451fbab1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.647686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-28f4f629-10a9-457c-a1d6-5790eb34b977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f08bd3d98345368bc9a470451fbab1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.655091 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1246/2482] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:10 2022] DELETE /identity/v3/users/46f08bd3d98345368bc9a470451fbab1 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:11.592781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:11.594331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:11.608423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f0bfb-fa7d-4370-bda8-8e6c7c93943a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:11.622193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:11.668324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:11.668958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:11.669239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:11.669511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] PATH_INFO: `/v3/projects/104ee75a74ed410094b97de1f1341105` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:11.670666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104ee75a74ed410094b97de1f1341105)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:11.672643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:11.815331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104ee75a74ed410094b97de1f1341105', 'request_id': 'req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:11.821371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104ee75a74ed410094b97de1f1341105', 'request_id': 'req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:11.827647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104ee75a74ed410094b97de1f1341105', 'request_id': 'req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:11.935892 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] The token cache is being invalidate because project 104ee75a74ed410094b97de1f1341105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:11.936201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:11.936929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-6c9e8e20-1c29-4c69-986b-b98f42cf5a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:11.938829 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1237/2483] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:11 2022] DELETE /identity/v3/projects/104ee75a74ed410094b97de1f1341105 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:11.944216 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:11.944713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:11.944926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:11.966532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:11.968118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:12.047722 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1247/2484] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:12.055793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.056138 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.056506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.083732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:12.085884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:12.095645 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1238/2485] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:12.100357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.112075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0994e-ceb8-4a86-9a61-f3469086d845 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.118001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.119052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.122049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.122049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.122049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:12.122049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.123437 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.140797 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1248/2486] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:12.142728 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.153083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde313-3943-42ca-8aee-f15f043d9ccf None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.159951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.160677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.161104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.161539 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.162370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.164455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.284823 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1239/2487] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:12 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:12.285697 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.296868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37f6a-2afc-43fe-bea7-18ec7bab9d65 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.350088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:12.368605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.369346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.369728 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.370124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.370849 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.372868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.544123 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1249/2488] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:12 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:12.544949 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.556801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7bdf-c620-4db7-9abe-804d760ca5de admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.561909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.562519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.563012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.563139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.563692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.565291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.577037 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1240/2489] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:12.586924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.607990 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7401e-41ae-4081-a7f9-a7d2673f6f35 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.616125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.618279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.618741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.619114 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.619980 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.621676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb040c6-194f-44fc-8a5b-0db827fe5cd5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.637884 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1250/2490] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:12.639070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.650403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcef1b1-ab87-411d-a156-220c8bfe4320 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.655477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.656253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.656415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.656818 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] PATH_INFO: `/v3/projects/cdba730fa3e24e94afc5281c31f6b174/users/fb783da25b4e4a1ea4092888e4b74d97/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.674399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdba730fa3e24e94afc5281c31f6b174, user_id=fb783da25b4e4a1ea4092888e4b74d97, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.677663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.763106 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1241/2491] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:12 2022] PUT /identity/v3/projects/cdba730fa3e24e94afc5281c31f6b174/users/fb783da25b4e4a1ea4092888e4b74d97/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:12.837523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.838064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.838537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.876146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] MFA Rules not processed for user `fb783da25b4e4a1ea4092888e4b74d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:12.877726 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:12.960998 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1251/2492] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:12.965656 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.021042 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:13.040034 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fefcb5-cedc-477d-9932-8c376cb96613 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.046750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.047522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.047997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.048273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.048945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.050963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.185893 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1242/2493] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:12 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:13.187256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.201033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27920549-8526-4a1c-93c2-1e04980b6935 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.277974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.278593 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.296135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.296135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.296135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.296135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.382387 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1252/2494] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:13 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:13.386493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.402221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eef58-53db-41bc-8d4f-58033e4afc4c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.407837 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.408734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.414923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.414923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.414923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.414923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.425522 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1243/2495] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:13.430317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.441747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd22c8b-d947-4f63-86dc-c39a9399efdc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.447323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.448110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.448702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.452754 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] PATH_INFO: `/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96/users/5e5247a5e8044cb4ac62077ae9d94395/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.479670 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cacae05a26d4bb9878fb13cc8c1ed96, user_id=5e5247a5e8044cb4ac62077ae9d94395, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.482985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.559237 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1253/2496] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:13 2022] PUT /identity/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96/users/5e5247a5e8044cb4ac62077ae9d94395/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:13.563332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.573398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204feb34-75f1-449c-ac36-12d027397548 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.632215 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.632909 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.633168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.633441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.634110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.635765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649a7f-468b-4dc3-9f6d-9e21cef3462b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.646454 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1244/2497] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:13.650725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.666213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d714-4b0d-4765-8e67-2dc29671ae94 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.671711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.672357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.672638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.672913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] PATH_INFO: `/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96/users/5e5247a5e8044cb4ac62077ae9d94395/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.675546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cacae05a26d4bb9878fb13cc8c1ed96, user_id=5e5247a5e8044cb4ac62077ae9d94395, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.678380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.688773 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1254/2498] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:13 2022] PUT /identity/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96/users/5e5247a5e8044cb4ac62077ae9d94395/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:13.702299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.702597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.702877 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.734051 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] MFA Rules not processed for user `5e5247a5e8044cb4ac62077ae9d94395`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:13.735277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:13.811340 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1245/2499] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:13.823013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.824730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:13.829543 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:13.923370 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b431d-8895-4f5e-8594-e65b7ee17222 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.928514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.929137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.929424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.929704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.994718 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.996472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.008404 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1255/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:20.165434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:20.166948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:20.214269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:20.269971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d64e1-012f-4b93-8a48-057f96979c48 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:20.275899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:20.276504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:20.276787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:20.277062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:20.278798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:20.290311 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:20.291901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194edc0d-8bd4-4ea1-be28-480e381c4f41 service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:20.301615 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1246/2501] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:21.246755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:21.255711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee6267-98d8-40d0-bb89-076528fe7161 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:21.260248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:21.260889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:21.261177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:21.261458 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:21.271298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:21.272796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:21.283168 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1256/2502] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:26.511797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.512275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.512390 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.531747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:26.532970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:26.586218 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1247/2503] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:26.598591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:26.599976 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:26.668402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69316a-ffc9-4573-a827-f58592d3e04b service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:26.673356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:26.673984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.674269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.674544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.682600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:26.684210 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4eb2-d717-4245-9527-eb369d89c057 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:26.692131 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1257/2504] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:28.197484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.308747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c5ada-727e-4946-961c-ca639fd69419 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.313812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.314767 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.315055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.315334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] PATH_INFO: `/v3/users/fb783da25b4e4a1ea4092888e4b74d97` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.316529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb783da25b4e4a1ea4092888e4b74d97)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.318505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.610889 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb783da25b4e4a1ea4092888e4b74d97'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:28.618704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb783da25b4e4a1ea4092888e4b74d97'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:28.620634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:28.745078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb783da25b4e4a1ea4092888e4b74d97'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:28.745791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb783da25b4e4a1ea4092888e4b74d97'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:28.761699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb783da25b4e4a1ea4092888e4b74d97'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:28.768639 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1248/2505] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:28 2022] DELETE /identity/v3/users/fb783da25b4e4a1ea4092888e4b74d97 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:28.773387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.774048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.774224 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.796667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:28.798089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:28.810320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:28.869018 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1258/2506] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:28.878703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.880136 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:28.942855 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc68b-086f-44c1-bdfd-7d842add447a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.946528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.947141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.947423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.947700 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.958052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.959659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.985087 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1249/2507] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:29.440012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:29.441594 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:29.462826 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453945-b9d4-44f7-b541-b49010d11fd4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:29.467785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:29.468619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:29.468965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:29.469311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] PATH_INFO: `/v3/projects/cdba730fa3e24e94afc5281c31f6b174` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:29.470568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdba730fa3e24e94afc5281c31f6b174)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:29.473014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:29.613928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdba730fa3e24e94afc5281c31f6b174', 'request_id': 'req-d30c016d-e6bd-448c-b2a7-df4942e55a36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:29.620188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdba730fa3e24e94afc5281c31f6b174', 'request_id': 'req-d30c016d-e6bd-448c-b2a7-df4942e55a36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:29.626380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdba730fa3e24e94afc5281c31f6b174', 'request_id': 'req-d30c016d-e6bd-448c-b2a7-df4942e55a36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:29.713346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] The token cache is being invalidate because project cdba730fa3e24e94afc5281c31f6b174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:29.713675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:29.714624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:29.719387 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1259/2508] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:29 2022] DELETE /identity/v3/projects/cdba730fa3e24e94afc5281c31f6b174 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:29.720615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:29.730772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b28f2-10a5-4804-b9c2-e5c72877d390 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:29.791055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:29.791686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:29.791967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:29.792244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] PATH_INFO: `/v3/users/5e5247a5e8044cb4ac62077ae9d94395` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:29.793374 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5247a5e8044cb4ac62077ae9d94395)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:29.795337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:30.004343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5247a5e8044cb4ac62077ae9d94395'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.020806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5247a5e8044cb4ac62077ae9d94395'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.087786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5247a5e8044cb4ac62077ae9d94395'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.088472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5247a5e8044cb4ac62077ae9d94395'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.102461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:30.104083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b5694790-5d67-41eb-8169-f58dbc96be23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5247a5e8044cb4ac62077ae9d94395'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.110468 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1250/2509] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:29 2022] DELETE /identity/v3/users/5e5247a5e8044cb4ac62077ae9d94395 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:30.553480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:30.554982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:30.568504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c016d-e6bd-448c-b2a7-df4942e55a36 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:30.634163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:30.634958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:30.635236 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:30.635512 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] PATH_INFO: `/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:30.636717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cacae05a26d4bb9878fb13cc8c1ed96)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:30.638666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:30.753124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:30.759310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cacae05a26d4bb9878fb13cc8c1ed96', 'request_id': 'req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.764660 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cacae05a26d4bb9878fb13cc8c1ed96', 'request_id': 'req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.770844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cacae05a26d4bb9878fb13cc8c1ed96', 'request_id': 'req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.876740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] The token cache is being invalidate because project 1cacae05a26d4bb9878fb13cc8c1ed96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:30.877034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.877689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df5ccebc-988f-472d-8bcd-6ab8e31a82bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:30.879238 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1260/2510] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:30 2022] DELETE /identity/v3/projects/1cacae05a26d4bb9878fb13cc8c1ed96 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:30.886185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:30.886831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:30.887596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:30.912243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:30.913470 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:30.981056 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1251/2511] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:30.991462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:30.991759 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:30.992041 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.011900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:31.013204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:31.021200 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1261/2512] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:31.026156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.036086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a532976-2ed1-4690-b357-0ea2e74c89d1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.041869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.045826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.045826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.045826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.045826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:31.045826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.046766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.059982 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1252/2513] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:31.064564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.075126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5feac0-dd0e-4f5c-a687-4eef2a834ff6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.082047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.085938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.085938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.085938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.085938 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.086251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.274016 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1262/2514] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:31 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:31.278707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.292098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a502e9-1abf-497a-ad8a-6bab7030ea08 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.356776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.357387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.357668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.357984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.358675 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.360629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.481657 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1253/2515] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:31 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:31.483237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.494636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640368-b95e-4148-8339-1de85c8add07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.500019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.500631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.500917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.501195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.501948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.503483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.515008 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1263/2516] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:31.518858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.530134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d03ab9-04ba-47b1-8a4a-4b6a93993dab admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.535308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.535973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.536333 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.536620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.537340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.539196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2c7a6-4085-4bac-888a-5e2529b2d901 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.551643 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1254/2517] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:31.556347 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.566578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdff86-0ef0-4b16-8db9-215a1c0947a1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.571814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.572554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.572835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.573111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] PATH_INFO: `/v3/projects/ca50e7d1947143c582793e691c95b540/users/af2c304eff9a4bc1a901d5354958d459/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.589712 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca50e7d1947143c582793e691c95b540, user_id=af2c304eff9a4bc1a901d5354958d459, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.592547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.696117 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1264/2518] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:31 2022] PUT /identity/v3/projects/ca50e7d1947143c582793e691c95b540/users/af2c304eff9a4bc1a901d5354958d459/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:25:31.708935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.709221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.709497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.738622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] MFA Rules not processed for user `af2c304eff9a4bc1a901d5354958d459`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:31.739859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:31.807809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:31.834137 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1255/2519] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:31.846574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.848774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:31.911306 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e27d-46bc-411c-91fd-04d0512c157c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.915932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.916539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.916823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.917101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:31.925813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:31.927419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cb1f4-9307-4e8f-bb04-7ce18bb15251 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:31.936540 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1265/2520] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:31.958291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:32.030208 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075252-746f-4398-b4b6-597409fb1b32 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:32.034781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:32.035434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:32.035722 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:32.036001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] PATH_INFO: `/v3/users/af2c304eff9a4bc1a901d5354958d459` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:32.037167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2c304eff9a4bc1a901d5354958d459)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:32.039139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:32.211529 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2c304eff9a4bc1a901d5354958d459'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:32.218257 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2c304eff9a4bc1a901d5354958d459'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:32.283151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2c304eff9a4bc1a901d5354958d459'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:32.283781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2c304eff9a4bc1a901d5354958d459'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:32.299168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2c304eff9a4bc1a901d5354958d459'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:32.307074 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1256/2521] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:31 2022] DELETE /identity/v3/users/af2c304eff9a4bc1a901d5354958d459 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:32.314131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:32.314431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:32.314710 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:32.361861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:32.363132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:32.457437 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1266/2522] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:32.464912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:32.466297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:32.534733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e92a9-7744-4ba0-b70a-808cc1b99000 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:32.538621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:32.539296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:32.539723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:32.540096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:32.553383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:32.555074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f075-ede1-4b49-a86a-784d1e3261de service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:32.572182 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1257/2523] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:33.137100 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:33.142147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:33.152309 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a1ce-bb71-4d96-90a1-24c0460f6998 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:33.157296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:33.158008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.158317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.158689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] PATH_INFO: `/v3/projects/ca50e7d1947143c582793e691c95b540` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.159853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca50e7d1947143c582793e691c95b540)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:33.162093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:33.164977 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:33.297342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca50e7d1947143c582793e691c95b540', 'request_id': 'req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:33.305729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca50e7d1947143c582793e691c95b540', 'request_id': 'req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:33.313571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca50e7d1947143c582793e691c95b540', 'request_id': 'req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:33.422819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] The token cache is being invalidate because project ca50e7d1947143c582793e691c95b540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:33.422819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:33.423280 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fa3dd380-5fd2-43cb-ad4c-901fb9606b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:33.428228 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1267/2524] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:33 2022] DELETE /identity/v3/projects/ca50e7d1947143c582793e691c95b540 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:33.431083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.431791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.432524 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.457090 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:33.458537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:33.469109 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:33.588823 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1258/2525] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:33.597144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.601474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.601474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.622367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:33.624034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:33.634163 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1268/2526] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:33.638613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:33.648563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0673d-6e92-4873-99d0-5e1da0e2a595 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:33.653720 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:33.654286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.659039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.659039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.659039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:33.659039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:33.659039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:33.682071 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1259/2527] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:33.685083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:33.700510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86f7c4-c6a6-4f21-b003-241da152ec17 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:33.706351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:33.707553 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.708116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.708614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.709608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:33.713217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:33.832569 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1269/2528] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:33 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:33.836883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:33.847382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd3f9-843d-4662-a6a3-49ca7345fd2f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:33.905736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:33.906291 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.906574 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.906852 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.907490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:33.909457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:34.090376 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1260/2529] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:33 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:34.094489 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:34.104971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aab6-6d42-4689-84be-572d257bd781 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:34.109620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:34.110260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:34.110542 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:34.110815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:34.111463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:34.113063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:34.124972 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1270/2530] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:34.135460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:34.153970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea66a-9e88-4073-b17e-9ef9588a5b8b admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:34.160577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:34.161296 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:34.161612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:34.161933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:34.162704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:34.165270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4a5e-12bc-45ad-af56-2ea1660aa815 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:34.177718 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1261/2531] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:34.183030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:34.195477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1a78a-7f99-48ed-8ff5-4e41f3228de6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:34.201241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:34.202020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:34.202343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:34.202639 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] PATH_INFO: `/v3/projects/8edaefc01f2046c1a1a4d0ddcf17f033/users/1b58c8b8710249a396b020310a77a407/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:34.221266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edaefc01f2046c1a1a4d0ddcf17f033, user_id=1b58c8b8710249a396b020310a77a407, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:34.224166 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:35.337462 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1271/2532] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:34 2022] PUT /identity/v3/projects/8edaefc01f2046c1a1a4d0ddcf17f033/users/1b58c8b8710249a396b020310a77a407/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:35.350203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:35.351414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:35.352758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:35.384370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] MFA Rules not processed for user `1b58c8b8710249a396b020310a77a407`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:35.386008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:35.474845 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1262/2533] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:35.475267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:35.552434 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd4eab-80b4-41e4-8807-d7e2aa70fa92 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:35.557948 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:35.558689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:35.559075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:35.559457 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:35.560259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:35.562335 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:35.775615 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1272/2534] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:35 2022] POST /identity/v3/projects => generated 373 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:35.779707 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:35.790933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2335ec-1034-455f-a286-569808d0de8a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:35.795530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:35.853310 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:35.854039 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:35.854321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:35.854595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:35.855220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:35.857147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:35.947031 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1263/2535] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:35 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:35.951051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:35.965535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4872-d2e8-4bd9-81b5-ba97637af284 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:35.973016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:35.978040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:35.978040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:35.978040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:35.978040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:35.978040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:35.989944 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1273/2536] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:35.995872 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:36.007126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bfbd9-0bd9-483c-9c5b-312fc994ab00 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:36.013463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:36.014156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:36.014441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:36.014719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] PATH_INFO: `/v3/projects/1a415aa2756a4986bf90136fae1e465d/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:36.031084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a415aa2756a4986bf90136fae1e465d, user_id=d3cf2cdc7bd04b88bffd5d6c8a6eb727, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:36.033771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:36.094839 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1264/2537] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:35 2022] PUT /identity/v3/projects/1a415aa2756a4986bf90136fae1e465d/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:25:36.107627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:36.113870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:36.120569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13fef-cc1d-4d60-b111-223b948efcdc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:36.176810 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:36.177415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:36.177704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:36.178013 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:36.178653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:36.180890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2744e5-d0a4-465b-87b9-a1a10accbb4d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:36.190449 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1274/2538] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:36.194572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:36.205437 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29781-542b-4305-ab31-3daf13f7ccdd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:36.211249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:36.211895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:36.212175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:36.212451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] PATH_INFO: `/v3/projects/1a415aa2756a4986bf90136fae1e465d/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:36.214406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a415aa2756a4986bf90136fae1e465d, user_id=d3cf2cdc7bd04b88bffd5d6c8a6eb727, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:36.217154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:36.227687 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1265/2539] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:36 2022] PUT /identity/v3/projects/1a415aa2756a4986bf90136fae1e465d/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:36.238048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:36.238363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:36.238642 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:36.267649 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] MFA Rules not processed for user `d3cf2cdc7bd04b88bffd5d6c8a6eb727`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:36.268924 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:36.336997 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1275/2540] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:36.347798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:36.349589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:36.406887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aace5-1035-447a-bf3e-65c22ff1665f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:36.410673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:36.411274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:36.411560 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:36.411836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:36.468129 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:36.469580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe2527-d765-4df8-91c0-f20e3531b1a9 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:36.479291 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1266/2541] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:40.926192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:40.992412 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e10a8d-867d-4e9b-b8bd-b041ebf013de None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:40.998647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:40.999298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:40.999585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:40.999864 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] PATH_INFO: `/v3/users/1b58c8b8710249a396b020310a77a407` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:41.001072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b58c8b8710249a396b020310a77a407)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:41.003116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:41.158464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:41.302311 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b58c8b8710249a396b020310a77a407'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:41.380240 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b58c8b8710249a396b020310a77a407'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:41.388061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b58c8b8710249a396b020310a77a407'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:41.388686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b58c8b8710249a396b020310a77a407'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:41.400854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b58c8b8710249a396b020310a77a407'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:41.407672 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1276/2542] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:40 2022] DELETE /identity/v3/users/1b58c8b8710249a396b020310a77a407 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:41.412238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:41.412693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:41.412795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:41.431637 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:41.432836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:41.442116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:41.500069 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1267/2543] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:41.510029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:41.511538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:41.570763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606579-cee6-42da-8eb1-78e14a8b7f69 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:41.574333 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:41.579700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:41.579700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:41.579700 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:41.584920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:41.586689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:41.597310 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1277/2544] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:42.033734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:42.035378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:42.047736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144b8c-2b3c-4e88-9be3-5c7c3955d7fe None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:42.054214 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:42.055230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:42.055588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:42.055933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] PATH_INFO: `/v3/projects/8edaefc01f2046c1a1a4d0ddcf17f033` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:42.057398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edaefc01f2046c1a1a4d0ddcf17f033)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:42.060430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:42.221769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edaefc01f2046c1a1a4d0ddcf17f033', 'request_id': 'req-df81c14f-d76f-438a-8683-7bcdb63179fd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.227221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edaefc01f2046c1a1a4d0ddcf17f033', 'request_id': 'req-df81c14f-d76f-438a-8683-7bcdb63179fd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.234102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edaefc01f2046c1a1a4d0ddcf17f033', 'request_id': 'req-df81c14f-d76f-438a-8683-7bcdb63179fd'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.351264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] The token cache is being invalidate because project 8edaefc01f2046c1a1a4d0ddcf17f033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:42.351556 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.352180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.353669 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1268/2545] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:42 2022] DELETE /identity/v3/projects/8edaefc01f2046c1a1a4d0ddcf17f033 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:42.358465 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:42.369128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e225d-ed5e-43c9-8437-914cbc585a19 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:42.434656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:42.435281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:42.435571 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:42.435877 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] PATH_INFO: `/v3/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:42.437045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cf2cdc7bd04b88bffd5d6c8a6eb727)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:42.439044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:42.696764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cf2cdc7bd04b88bffd5d6c8a6eb727'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.698629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:42.807474 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cf2cdc7bd04b88bffd5d6c8a6eb727'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.814815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cf2cdc7bd04b88bffd5d6c8a6eb727'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.815447 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cf2cdc7bd04b88bffd5d6c8a6eb727'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.827929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0866860f-4657-4bac-a98d-abcbd473bdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cf2cdc7bd04b88bffd5d6c8a6eb727'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:42.833871 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1278/2546] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:42 2022] DELETE /identity/v3/users/d3cf2cdc7bd04b88bffd5d6c8a6eb727 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:43.283621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:43.290631 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:43.302642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c14f-d76f-438a-8683-7bcdb63179fd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:43.366115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:43.366746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.367027 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.367301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] PATH_INFO: `/v3/projects/1a415aa2756a4986bf90136fae1e465d` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.368451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a415aa2756a4986bf90136fae1e465d)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:43.370430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:43.479942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:43.486406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a415aa2756a4986bf90136fae1e465d', 'request_id': 'req-43120a82-14b6-46b6-9806-7fa8e09889af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:43.491901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a415aa2756a4986bf90136fae1e465d', 'request_id': 'req-43120a82-14b6-46b6-9806-7fa8e09889af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:43.498836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a415aa2756a4986bf90136fae1e465d', 'request_id': 'req-43120a82-14b6-46b6-9806-7fa8e09889af'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:43.576676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] The token cache is being invalidate because project 1a415aa2756a4986bf90136fae1e465d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:43.576676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:43.576676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-43120a82-14b6-46b6-9806-7fa8e09889af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:43.576676 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1269/2547] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:43 2022] DELETE /identity/v3/projects/1a415aa2756a4986bf90136fae1e465d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:43.580591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.581040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.581153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.602472 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:43.603672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:43.789679 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1279/2548] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:43.797781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.798122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.798400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.817948 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:43.820681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:43.827868 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1270/2549] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:43.832180 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:43.842704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30048-4fc0-45f1-aa33-676932239d60 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:43.847231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:43.847831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.848108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.848378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.849018 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:43.849324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:43.850949 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:43.862455 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1280/2550] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:43.866629 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:43.876301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9f750-c28c-4d6f-a981-68b9f3703af5 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:43.880860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:43.881445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.884037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.884037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.884037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:43.884682 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:43.993097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1271/2551] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:43 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:43.997762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.007682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026906a-9308-4f85-a937-1da2c70059d7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.063434 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.064025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.064302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.064588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.065218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.067167 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.174546 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1281/2552] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:43 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:44.178825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.189797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f07528-5fe6-4baa-9b60-545cd6ef2819 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.194566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.196381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.196381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.196381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.196684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.198085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.209508 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1272/2553] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:44.213544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.223573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f78e49-2c38-45ce-8c33-370a50c3d175 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.228209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.228801 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.229084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.229346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.230014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.232170 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6792700-db5d-4e81-a058-cd9062b7f3d2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.243176 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1282/2554] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:44.248085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.258489 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbc268-10bc-478f-b733-4555543dcbc6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.264244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.264912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.265196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.265523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] PATH_INFO: `/v3/projects/6692544b38264b1c94104e234259848b/users/7dbfda28a57647f1955e38acf410d18f/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.281617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6692544b38264b1c94104e234259848b, user_id=7dbfda28a57647f1955e38acf410d18f, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.284097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.369731 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1273/2555] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:44 2022] PUT /identity/v3/projects/6692544b38264b1c94104e234259848b/users/7dbfda28a57647f1955e38acf410d18f/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:25:44.375737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f0c8-0247-4172-87e1-ff01117916f7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.376024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f0c8-0247-4172-87e1-ff01117916f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.376324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f0c8-0247-4172-87e1-ff01117916f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.396342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d2c5f0c8-0247-4172-87e1-ff01117916f7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:44.401545 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d2c5f0c8-0247-4172-87e1-ff01117916f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.426800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:44.462808 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1283/2556] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:44.472897 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.474748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.542671 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad9b6-a075-4f5d-85b5-6732033318da admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.547161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.547772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.548055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.548372 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.557692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.559725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.572015 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1274/2557] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:46.283574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534a75-14e0-47a4-b53c-6fc18daa8c91 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:46.284061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534a75-14e0-47a4-b53c-6fc18daa8c91 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:46.284158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534a75-14e0-47a4-b53c-6fc18daa8c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:46.314668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-88534a75-14e0-47a4-b53c-6fc18daa8c91 None None] MFA Rules not processed for user `7dbfda28a57647f1955e38acf410d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:46.315956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88534a75-14e0-47a4-b53c-6fc18daa8c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:46.392418 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1284/2558] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:46.407000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:46.409711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:46.507258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19dd57-b185-41a6-be7a-52843e38264b service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:46.516091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:46.516706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:46.516981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:46.518287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:46.534820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:46.536270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e8d15-097b-4bad-b9e6-3cd543c0854d service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:46.549154 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1275/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:48.411607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:48.412258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:48.412258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:48.432492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] MFA Rules not processed for user `7dbfda28a57647f1955e38acf410d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:48.433708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:48.441018 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1285/2560] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:51.042907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:51.042907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:51.042907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:51.065505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] MFA Rules not processed for user `2a756f12e29a4854be7a4ff1ef0d574c`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:51.071715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:51.073104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:51.124700 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1276/2561] 10.222.0.36 () {58 vars in 967 bytes} [Sun Aug 7 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:51.136906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:51.138356 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:51.207026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b54cdc-3450-41b0-b0ec-e33123a9c6de None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:51.212275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9deb5a597756481c89061d48e6632961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:51.212879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:51.213186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:51.213460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:51.221455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:51.223082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:51.231563 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1286/2562] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:52.873370 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:52.874854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:52.886349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c20a2-18f6-424f-9149-94647198ce50 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:52.889954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:52.890554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:52.890838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:52.891124 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:52.892792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:52.905172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:52.906649 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:52.916477 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1277/2563] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:01.227972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=80 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:02.637301 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.639428 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:02.656737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638575c-3f89-4859-b546-537694db7e79 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:02.662937 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.663576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.663854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.664482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] PATH_INFO: `/v3/users/cb1bbc1683f24a5aa356438e533e1fb1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.665276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1bbc1683f24a5aa356438e533e1fb1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.667305 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.879017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1bbc1683f24a5aa356438e533e1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:02.918391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=26 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:02.962785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1bbc1683f24a5aa356438e533e1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:02.970239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1bbc1683f24a5aa356438e533e1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:02.970870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1bbc1683f24a5aa356438e533e1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:02.988292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1bbc1683f24a5aa356438e533e1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:02.994524 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1287/2564] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:02 2022] DELETE /identity/v3/users/cb1bbc1683f24a5aa356438e533e1fb1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:03.277377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.287920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d09a13-bae3-4e51-bc56-cc90dfb6d8d8 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.345364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.346020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.346305 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.346583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] PATH_INFO: `/v3/projects/4de628a664a84c279bfdaa7105972fd4` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.347790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de628a664a84c279bfdaa7105972fd4)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.349749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.456217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de628a664a84c279bfdaa7105972fd4', 'request_id': 'req-839b3d14-938d-4d9c-9363-e424956c5a92'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.462420 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de628a664a84c279bfdaa7105972fd4', 'request_id': 'req-839b3d14-938d-4d9c-9363-e424956c5a92'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.469914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de628a664a84c279bfdaa7105972fd4', 'request_id': 'req-839b3d14-938d-4d9c-9363-e424956c5a92'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.561249 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] The token cache is being invalidate because project 4de628a664a84c279bfdaa7105972fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:03.561537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.562240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.563706 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1278/2565] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:03 2022] DELETE /identity/v3/projects/4de628a664a84c279bfdaa7105972fd4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:03.567711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.569123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:03.583225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb747-d3e8-4f46-8089-a208360245a6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.642557 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.644511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.644796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.645077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] PATH_INFO: `/v3/users/3477ec9af9274781ac4168c75f923458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.646281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3477ec9af9274781ac4168c75f923458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.648212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.855684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3477ec9af9274781ac4168c75f923458'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.938750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3477ec9af9274781ac4168c75f923458'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.946096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3477ec9af9274781ac4168c75f923458'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.946742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3477ec9af9274781ac4168c75f923458'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.954981 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:03.959206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3477ec9af9274781ac4168c75f923458'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:03.965113 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1288/2566] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:03 2022] DELETE /identity/v3/users/3477ec9af9274781ac4168c75f923458 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:04.205008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:04.206507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:04.220759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3d14-938d-4d9c-9363-e424956c5a92 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:04.277202 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:04.277820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:04.278140 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:04.278449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] PATH_INFO: `/v3/projects/1927ddf53e5b40b4b4832a540d010eb1` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:04.279639 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1927ddf53e5b40b4b4832a540d010eb1)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:04.281570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:04.397484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:04.411172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1927ddf53e5b40b4b4832a540d010eb1', 'request_id': 'req-ded78170-84a7-4032-932c-18a1baa8d6c2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:04.418345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1927ddf53e5b40b4b4832a540d010eb1', 'request_id': 'req-ded78170-84a7-4032-932c-18a1baa8d6c2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:04.426002 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1927ddf53e5b40b4b4832a540d010eb1', 'request_id': 'req-ded78170-84a7-4032-932c-18a1baa8d6c2'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:04.489263 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] The token cache is being invalidate because project 1927ddf53e5b40b4b4832a540d010eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:04.489557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:04.490230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:04.491744 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1279/2567] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:04 2022] DELETE /identity/v3/projects/1927ddf53e5b40b4b4832a540d010eb1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:09.571847 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:09.573258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:09.632452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b1a5-7346-4f28-b006-4b843a359c71 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:09.682086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6794a3-405d-4711-adef-349886778485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:09.682717 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794a3-405d-4711-adef-349886778485 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:09.683002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794a3-405d-4711-adef-349886778485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:09.683273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794a3-405d-4711-adef-349886778485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:09.685067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de6794a3-405d-4711-adef-349886778485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:09.752624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6794a3-405d-4711-adef-349886778485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:09.754098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6794a3-405d-4711-adef-349886778485 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:09.764376 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1289/2568] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:26:13.678016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:13.679928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:13.693261 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78170-84a7-4032-932c-18a1baa8d6c2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:13.698092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:13.698723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:13.699011 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:13.699289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] PATH_INFO: `/v3/users/4c8389683e844b989fe5cbe779327933` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:13.700945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8389683e844b989fe5cbe779327933)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:13.703063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:13.943325 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8389683e844b989fe5cbe779327933'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:13.951444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8389683e844b989fe5cbe779327933'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.042853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8389683e844b989fe5cbe779327933'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.043490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8389683e844b989fe5cbe779327933'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.056126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e0febc90-a85c-4d6a-85a1-87f82f901db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8389683e844b989fe5cbe779327933'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.062507 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1280/2569] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:13 2022] DELETE /identity/v3/users/4c8389683e844b989fe5cbe779327933 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:14.325739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6794a3-405d-4711-adef-349886778485 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:14.333418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6794a3-405d-4711-adef-349886778485 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:14.387185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:14.393278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:14.394008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.394291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.394567 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] PATH_INFO: `/v3/projects/440652d4d24d4a34985625be49c12a70` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.395739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=440652d4d24d4a34985625be49c12a70)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:14.397668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:14.578918 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440652d4d24d4a34985625be49c12a70', 'request_id': 'req-61270029-19ec-4389-8a09-82ba85ab45bf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.584498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440652d4d24d4a34985625be49c12a70', 'request_id': 'req-61270029-19ec-4389-8a09-82ba85ab45bf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.591417 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440652d4d24d4a34985625be49c12a70', 'request_id': 'req-61270029-19ec-4389-8a09-82ba85ab45bf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.671197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] The token cache is being invalidate because project 440652d4d24d4a34985625be49c12a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:14.671492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.672137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61270029-19ec-4389-8a09-82ba85ab45bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:14.675267 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1290/2570] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:14 2022] DELETE /identity/v3/projects/440652d4d24d4a34985625be49c12a70 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:14.680286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.680827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.680827 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.703991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:14.705304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:14.765951 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1281/2571] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:14.773741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691143-12fe-453d-a31a-cb3c099803af None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.774067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691143-12fe-453d-a31a-cb3c099803af None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.774348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691143-12fe-453d-a31a-cb3c099803af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.794806 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-de691143-12fe-453d-a31a-cb3c099803af None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:14.796290 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de691143-12fe-453d-a31a-cb3c099803af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:14.805175 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1291/2572] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:14.810126 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:14.820812 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7af05b-cafb-4f53-ba89-3bf62729771a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:14.826052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:14.826591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.826875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.827150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.827824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:14.828131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:14.829749 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:14.842545 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1282/2573] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:14.846842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691143-12fe-453d-a31a-cb3c099803af None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:14.857130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691143-12fe-453d-a31a-cb3c099803af None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:14.862007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:14.862612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.862893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.863165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.863794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:14.865796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:14.973362 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1292/2574] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:14.977308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:14.988427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710645-ee7a-4fc3-9384-1dfbc1d39984 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.005466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:15.045591 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.046245 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.046530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.046807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.047455 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.049492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.185889 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1283/2575] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:14 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:15.189124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:15.199511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd7674-da50-4b3f-a4fa-43be333b5f57 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.204682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.205300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.205580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.205878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.206519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.208108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.219230 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1293/2576] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:15.226745 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:15.236723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c0d4-6b47-43f0-a0dc-2b5c862f8435 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.241253 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.241881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.242141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.242421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.243052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.244624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18fc1-d90f-4a0a-a45c-ddfbb775f5a5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.255474 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1284/2577] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:15.259580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:15.270186 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5bdd9-d682-437d-9c32-ffc507b2a63e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.274756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.275397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.275681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.275958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] PATH_INFO: `/v3/projects/48e13052e79e4d578da99b7c5f52d304/users/b5c2fc3f3d5e4e7db1a13e24086e1f8e/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.290904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e13052e79e4d578da99b7c5f52d304, user_id=b5c2fc3f3d5e4e7db1a13e24086e1f8e, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.293719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.409482 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1294/2578] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:15 2022] PUT /identity/v3/projects/48e13052e79e4d578da99b7c5f52d304/users/b5c2fc3f3d5e4e7db1a13e24086e1f8e/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:15.414642 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4e6e-18ba-4a88-8b34-66dd6cad1d2b None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.414929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4e6e-18ba-4a88-8b34-66dd6cad1d2b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.415206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4e6e-18ba-4a88-8b34-66dd6cad1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.435400 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-008d4e6e-18ba-4a88-8b34-66dd6cad1d2b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:15.436693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-008d4e6e-18ba-4a88-8b34-66dd6cad1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:15.496049 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1285/2579] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:15.506538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:15.508243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:15.563821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7331-aa85-4011-9f0c-5a3938b130fa admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.567502 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.568094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.568377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.568651 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.578303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.579738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.589307 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1295/2580] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:21.019345 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91779-a15c-4ccf-9ded-4461b3089b3a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.019802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91779-a15c-4ccf-9ded-4461b3089b3a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.020077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91779-a15c-4ccf-9ded-4461b3089b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.055085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2ac91779-a15c-4ccf-9ded-4461b3089b3a None None] MFA Rules not processed for user `b5c2fc3f3d5e4e7db1a13e24086e1f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:21.056567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2ac91779-a15c-4ccf-9ded-4461b3089b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:21.135437 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1286/2581] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:21.155325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:21.155325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:21.190435 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:21.264274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb31b-43bb-4ccf-b469-b44673286ef1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:21.270135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:21.270904 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.271204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.271464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.280456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:21.282246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023da4-bddb-477f-85ef-ae44089c5c52 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:21.291278 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1296/2582] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:24.210406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:24.210945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:24.210945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:24.232357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] MFA Rules not processed for user `b5c2fc3f3d5e4e7db1a13e24086e1f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:24.233578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:24.240558 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1287/2583] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:31.899999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=31 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:32.847118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49a926-1b0a-4da8-b327-4ca6f7647808 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.847407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49a926-1b0a-4da8-b327-4ca6f7647808 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.847690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49a926-1b0a-4da8-b327-4ca6f7647808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.867534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4e49a926-1b0a-4da8-b327-4ca6f7647808 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:32.868737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4e49a926-1b0a-4da8-b327-4ca6f7647808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:32.876674 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1297/2584] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:32.897980 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:32.899415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:32.915566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ba3f3-5979-401c-bdf0-726e36d50abe None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:32.921701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:32.922321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.922606 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.922884 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.931040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:32.932803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:32.942596 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1288/2585] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:39.350030 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812ed2-fb09-46e9-969f-47aa6392aab4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.350617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812ed2-fb09-46e9-969f-47aa6392aab4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.350617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812ed2-fb09-46e9-969f-47aa6392aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.370845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1c812ed2-fb09-46e9-969f-47aa6392aab4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:39.372063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c812ed2-fb09-46e9-969f-47aa6392aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.380789 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1298/2586] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:39.400783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.412444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e18f-f114-4f50-93ba-577346bbe0f1 service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.417933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.418619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.418900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.419174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.425469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:39.427974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.429613 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.439476 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1289/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:26:45.878083 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067352-178b-4ecc-9d77-a17b12bcf139 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.878636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067352-178b-4ecc-9d77-a17b12bcf139 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.878636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec067352-178b-4ecc-9d77-a17b12bcf139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.897540 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ec067352-178b-4ecc-9d77-a17b12bcf139 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:45.900917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec067352-178b-4ecc-9d77-a17b12bcf139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:45.906624 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1299/2588] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:45.927166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.938337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e1b3-a779-4da3-813d-9ee83c25210d service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.944450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.945038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.945321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.945600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.953570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.958207 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.964874 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1290/2589] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:49.692256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c55e1-34a3-4cc2-9410-d1e8dd7d9377 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:49.692768 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c55e1-34a3-4cc2-9410-d1e8dd7d9377 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:49.692888 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c55e1-34a3-4cc2-9410-d1e8dd7d9377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:49.712188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8d1c55e1-34a3-4cc2-9410-d1e8dd7d9377 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:49.713372 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d1c55e1-34a3-4cc2-9410-d1e8dd7d9377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:49.721020 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1300/2590] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:49.743243 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:49.755233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeced2-6614-4e16-a590-3eb25dc87422 service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:49.760845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:49.761454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:49.761736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:49.762044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:49.771846 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:49.773433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:49.783097 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1291/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:54.026051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a9956-acde-4b1d-8bba-73d155b1c4af None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.026515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a9956-acde-4b1d-8bba-73d155b1c4af None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.026515 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a9956-acde-4b1d-8bba-73d155b1c4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.045676 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a65a9956-acde-4b1d-8bba-73d155b1c4af None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:54.046883 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a65a9956-acde-4b1d-8bba-73d155b1c4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:54.054624 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1301/2592] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:54.083701 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.095690 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d17f-1801-4d7c-a0f1-4ac8d5b49950 service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.101402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.102033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.102318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.102594 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.111091 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.112668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.122089 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1292/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:26:58.303889 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:58.304679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:58.304679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:58.324475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:58.325693 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:58.334601 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1302/2594] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:58.356289 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:58.367924 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff977a-e505-4457-a004-888638d2d70e service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:58.373398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:58.374029 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:58.374308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:58.374581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:58.383273 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:58.384836 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:58.394953 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1293/2595] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:01.022971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.024395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.036198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686ec5-c292-47e6-92b9-54a6a57317ae None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.039740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.042262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.042262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.042262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.042672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.055647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.057076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.068844 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1303/2596] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:02.265970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:02.276460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50435018-2e5d-48fd-aa52-ca526291eacc service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:02.280141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:02.280733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:02.281018 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:02.281293 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:02.283938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:02.298218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:02.299774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:02.311524 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1294/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:09.380619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:09.384683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=25 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:09.389695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb552-45be-4e6d-9843-b8387a4c25f6 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:09.394344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:09.395200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:09.395575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:09.395952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:09.397719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:09.410607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:09.412020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:09.421687 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1304/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:12.306777 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=32 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:12.918145 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:12.919773 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:12.936156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acea0a-5ec8-4a26-9fe1-8e1fd01c28b4 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:12.940973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:12.941605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:12.941921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:12.942398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] PATH_INFO: `/v3/users/598402f6609c422cbcc0dd0bfae53430` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:12.956730 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598402f6609c422cbcc0dd0bfae53430)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:12.958644 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:13.203402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598402f6609c422cbcc0dd0bfae53430'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.210883 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598402f6609c422cbcc0dd0bfae53430'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.286609 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598402f6609c422cbcc0dd0bfae53430'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.287233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598402f6609c422cbcc0dd0bfae53430'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.299975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-414b9f79-b1a3-4d7a-a1ea-d8250843d384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598402f6609c422cbcc0dd0bfae53430'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.305983 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1295/2599] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:12 2022] DELETE /identity/v3/users/598402f6609c422cbcc0dd0bfae53430 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:13.541401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:13.552591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99703979-42bf-4514-bf48-11dc5dd643f2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:13.609213 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:13.609885 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.610168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.610442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] PATH_INFO: `/v3/projects/6785d30930ee41d88a31ff0760f8d699` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.620572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6785d30930ee41d88a31ff0760f8d699)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:13.622531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:13.733232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6785d30930ee41d88a31ff0760f8d699', 'request_id': 'req-d3a28d73-4082-48a0-b789-1733e1a126fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.738827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6785d30930ee41d88a31ff0760f8d699', 'request_id': 'req-d3a28d73-4082-48a0-b789-1733e1a126fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.745655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6785d30930ee41d88a31ff0760f8d699', 'request_id': 'req-d3a28d73-4082-48a0-b789-1733e1a126fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.801358 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] The token cache is being invalidate because project 6785d30930ee41d88a31ff0760f8d699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:13.801647 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.802345 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d3a28d73-4082-48a0-b789-1733e1a126fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.803966 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1305/2600] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:13 2022] DELETE /identity/v3/projects/6785d30930ee41d88a31ff0760f8d699 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:13.812747 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.813233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.813337 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.834031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:13.835229 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:13.894910 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1296/2601] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:13.903243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.906487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.906487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.926266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:13.929404 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:13.935901 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1306/2602] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:13.940415 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:13.950990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91464-e6c2-416a-b5aa-d6daec992f97 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:13.957458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:13.958107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.958423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.958708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.959371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:13.959681 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:13.961319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:13.975408 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1297/2603] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:13.980062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:13.994674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001791-1902-4e86-bb34-e84fe1d09417 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:13.996483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:13.997078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.997357 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.997630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.998293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.000201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.115386 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1307/2604] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:13 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:27:14.121418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.131875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc91308-d837-4cfa-9172-24a7cacb8944 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.177895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:14.189338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.189958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.190239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.190513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.191135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.193044 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.273405 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1298/2605] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:14.277702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.288656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3d789-192d-43b2-817e-63b90257b615 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.293229 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.293825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.294134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.294408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.295046 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.296679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.306419 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1308/2606] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:14.310393 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.320274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6edeae-bae1-48c5-bb39-2bf36997716d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.324854 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.325441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.325725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.326037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.326674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.328255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3247faa-c3ae-4bdd-82c8-3e29c2900928 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.339625 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1299/2607] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:14.343551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.354093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259de2c-c4da-45f5-9c62-96547b5450ba admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.358672 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.359307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.359591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.359868 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] PATH_INFO: `/v3/projects/5ae7f3a1122944a79ce72c51917da1d0/users/734afd71645747b78bc4d5549e665625/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.374210 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae7f3a1122944a79ce72c51917da1d0, user_id=734afd71645747b78bc4d5549e665625, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.377064 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.448149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:14.453954 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1309/2608] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:14 2022] PUT /identity/v3/projects/5ae7f3a1122944a79ce72c51917da1d0/users/734afd71645747b78bc4d5549e665625/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:14.465589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.465915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.466196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.493627 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] MFA Rules not processed for user `734afd71645747b78bc4d5549e665625`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:14.494858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:14.559748 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1300/2609] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:14.564957 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.625260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce096-860f-4fe8-8ed3-3990cf111f6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.630504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.631095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.631377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.631646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.632251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.634197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.746415 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1310/2610] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:14.750460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.761517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5d8a4-49b4-4c40-bd61-ca3f99aa380f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.817459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.818150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.818362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.818641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.819260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.821182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.928063 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1301/2611] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:14.931897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.942753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4b74-1efb-4ef4-acd1-40469e8727f2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.947341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.947971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.948251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.948523 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.949163 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.950784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.962087 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1311/2612] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:14.966070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.975981 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438902-e85a-4321-8480-f0ed231f9dd5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.981155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.981807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.982119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.982395 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] PATH_INFO: `/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2/users/9d5597f310ca4441909bc87a2d316d8f/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.997612 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef5ce38626c418b88d7c4d56bfe2aa2, user_id=9d5597f310ca4441909bc87a2d316d8f, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:15.000373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.116799 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1302/2613] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:14 2022] PUT /identity/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2/users/9d5597f310ca4441909bc87a2d316d8f/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:15.120819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:15.132646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32bba4-f855-49c2-8629-0bbb2f0fc472 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:15.193165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:15.193692 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.194005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.194300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.194926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:15.196516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2fa51-5c59-48e8-b9e8-2ecf2216010d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.206129 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1312/2614] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:15.210450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:15.221945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba6f82-ad85-4482-a285-e64c2ff0ae68 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:15.226582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:15.228676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.228676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.228676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] PATH_INFO: `/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2/users/9d5597f310ca4441909bc87a2d316d8f/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.229704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef5ce38626c418b88d7c4d56bfe2aa2, user_id=9d5597f310ca4441909bc87a2d316d8f, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:15.232367 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.243566 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1303/2615] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:15 2022] PUT /identity/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2/users/9d5597f310ca4441909bc87a2d316d8f/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:15.255275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802283-6049-4519-b566-ae27170cf017 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.255556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802283-6049-4519-b566-ae27170cf017 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.255832 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802283-6049-4519-b566-ae27170cf017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.282342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-52802283-6049-4519-b566-ae27170cf017 None None] MFA Rules not processed for user `9d5597f310ca4441909bc87a2d316d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:15.284215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52802283-6049-4519-b566-ae27170cf017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:15.344276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:15.354424 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1313/2616] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:15.365799 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:15.367603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:15.378491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:15.425518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465121-835f-460b-828f-2db2a6a94f40 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:15.429256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:15.429879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.430164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.430439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.439698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:15.441067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926a071-fd9e-42b7-8659-b37d4e67a7ec service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.450517 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1304/2617] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:15.599464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802283-6049-4519-b566-ae27170cf017 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:15.660575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802283-6049-4519-b566-ae27170cf017 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:15.665138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:15.665762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.666077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.666351 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] PATH_INFO: `/v3/users/734afd71645747b78bc4d5549e665625` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.667460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734afd71645747b78bc4d5549e665625)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:15.669368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.883377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734afd71645747b78bc4d5549e665625'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:15.956532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734afd71645747b78bc4d5549e665625'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:15.964087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734afd71645747b78bc4d5549e665625'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:15.964763 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734afd71645747b78bc4d5549e665625'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:15.976794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734afd71645747b78bc4d5549e665625'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:15.982959 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1314/2618] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:15 2022] DELETE /identity/v3/users/734afd71645747b78bc4d5549e665625 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:15.987834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.988274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.988624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.007996 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:16.009185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:16.067059 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1305/2619] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:16.076724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:16.078182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:16.134511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7959548-0256-401d-8c73-c3e3d4ea40c0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:16.138004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:16.138601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:16.138882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:16.139158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.148772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:16.150245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d196fd-5f42-42b5-8cac-ef97eb995c4e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:16.159772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1315/2620] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:16.534775 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:16.536282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:16.548203 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e7a1a-8dd8-49f4-b3c5-3e1bddc0a0a6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:16.553384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:16.554067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:16.554351 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:16.554654 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] PATH_INFO: `/v3/projects/5ae7f3a1122944a79ce72c51917da1d0` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.555778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae7f3a1122944a79ce72c51917da1d0)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:16.557694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:16.610286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:16.610774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:16.611468 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.630499 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] MFA Rules not processed for user `7dbfda28a57647f1955e38acf410d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:16.631698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:16.640620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:16.685970 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1316/2621] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:16.718321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae7f3a1122944a79ce72c51917da1d0', 'request_id': 'req-294c5745-5e01-467f-b49f-7f44acdfb6ca'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:16.725268 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae7f3a1122944a79ce72c51917da1d0', 'request_id': 'req-294c5745-5e01-467f-b49f-7f44acdfb6ca'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:16.731616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae7f3a1122944a79ce72c51917da1d0', 'request_id': 'req-294c5745-5e01-467f-b49f-7f44acdfb6ca'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:16.802646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] The token cache is being invalidate because project 5ae7f3a1122944a79ce72c51917da1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:16.803111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:16.804301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:16.805752 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1306/2622] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:16 2022] DELETE /identity/v3/projects/5ae7f3a1122944a79ce72c51917da1d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:16.809705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:16.823162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e6f3b-a984-4b95-9f2e-728213609054 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:16.883282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:16.883912 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:16.884197 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:16.884470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] PATH_INFO: `/v3/users/9d5597f310ca4441909bc87a2d316d8f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.885630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5597f310ca4441909bc87a2d316d8f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:16.887577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:17.108336 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5597f310ca4441909bc87a2d316d8f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.202110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5597f310ca4441909bc87a2d316d8f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.211109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5597f310ca4441909bc87a2d316d8f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.211774 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5597f310ca4441909bc87a2d316d8f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.224621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f28b8164-a558-4841-a3d0-2ef3601c7046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5597f310ca4441909bc87a2d316d8f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.230457 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1317/2623] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:16 2022] DELETE /identity/v3/users/9d5597f310ca4441909bc87a2d316d8f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:17.666319 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:17.668387 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:17.683718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c5745-5e01-467f-b49f-7f44acdfb6ca admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:17.723187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:17.747209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:17.747828 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:17.748107 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:17.748381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] PATH_INFO: `/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:17.749523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef5ce38626c418b88d7c4d56bfe2aa2)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:17.752020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:17.882992 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef5ce38626c418b88d7c4d56bfe2aa2', 'request_id': 'req-512d0e5a-7420-4483-9a2d-e305d7ff9097'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.888823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef5ce38626c418b88d7c4d56bfe2aa2', 'request_id': 'req-512d0e5a-7420-4483-9a2d-e305d7ff9097'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.895331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef5ce38626c418b88d7c4d56bfe2aa2', 'request_id': 'req-512d0e5a-7420-4483-9a2d-e305d7ff9097'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.978823 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] The token cache is being invalidate because project 7ef5ce38626c418b88d7c4d56bfe2aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:17.979171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.980430 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-512d0e5a-7420-4483-9a2d-e305d7ff9097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:17.982183 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1307/2624] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:17 2022] DELETE /identity/v3/projects/7ef5ce38626c418b88d7c4d56bfe2aa2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:17.987574 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:17.988007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:17.988126 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.008181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:18.009371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:18.043138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:18.068457 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1318/2625] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:18.076403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.076692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.076972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.096842 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:18.098092 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:18.105790 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1308/2626] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:18.110272 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.120264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2cb8-a96e-4163-998b-19b6f22c5af1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.125047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.125340 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.125620 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.126067 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.127383 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:18.127840 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.129433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.140499 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1319/2627] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:18.144965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.154008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a430f-15e3-405f-bbb4-e4d832000f7e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.159439 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.160058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.164968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.164968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.164968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.164968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.277899 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1309/2628] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:27:18.281983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.292339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c6061-9339-473e-bfb8-b01b6184aacc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.349792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.350416 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.350695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.350992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.351613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.353524 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.448418 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1320/2629] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:18.452500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.465826 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2cfa-c544-4728-b5be-5e79f2973651 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.471106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.471731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.472009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.472904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.473739 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.476959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.489350 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1310/2630] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:18.490501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.500625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc405aaa-8332-4e5f-8165-5c9277b3e349 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.505454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.506111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.506394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.506664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.507302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.508945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35459653-bfea-45c1-9801-955d2213892a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.519843 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1321/2631] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:18.524082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.535488 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39459fb-b1fe-4fd6-aef4-14ef463d26c1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.540433 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.541077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.541389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.541663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] PATH_INFO: `/v3/projects/f4d0146b1a9d40d18e5e573985fa35a8/users/f28dad815c5a41598de4f7ce4137eb0c/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.557038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d0146b1a9d40d18e5e573985fa35a8, user_id=f28dad815c5a41598de4f7ce4137eb0c, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.559829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.660512 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1311/2632] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:18 2022] PUT /identity/v3/projects/f4d0146b1a9d40d18e5e573985fa35a8/users/f28dad815c5a41598de4f7ce4137eb0c/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:18.672113 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.672401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.672679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.699547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] MFA Rules not processed for user `f28dad815c5a41598de4f7ce4137eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:18.700739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:18.765297 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1322/2633] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:18.770306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.832875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dfa33-b726-4813-8069-b24a4c2e0a9e admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.837778 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.838398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.838679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.838951 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.839580 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.841475 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:18.847774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:18.964859 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1312/2634] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:18.969033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.980285 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb11e65-eb53-4b0f-9a05-8e66ddecf0d5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.012230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:19.035731 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.036266 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.036548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.036824 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.037459 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.039408 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.139586 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1323/2635] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:18 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:19.144563 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.154760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd718fb-cde5-45da-9e5b-2171ec1069b6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.159807 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.160445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.160732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.161008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.161658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.163366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.173696 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1313/2636] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:19.178194 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.188589 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3313ca-5d17-4921-821a-c00e8e86be27 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.194683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.195344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.195629 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.195908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] PATH_INFO: `/v3/projects/6bf0b393be514499a273f7577a17441d/users/a07ed4ffd49841a98b1c26158d82ac23/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.211582 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf0b393be514499a273f7577a17441d, user_id=a07ed4ffd49841a98b1c26158d82ac23, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.214564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.287917 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1324/2637] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:19 2022] PUT /identity/v3/projects/6bf0b393be514499a273f7577a17441d/users/a07ed4ffd49841a98b1c26158d82ac23/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:19.291809 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.302593 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85a75a-2a14-472e-a853-5edec6718600 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.362810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.363423 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.363768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.363982 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.364772 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.367000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327abbc-862f-435c-a606-906fdd7e6e04 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.381953 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1314/2638] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:19.383185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.396219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2bb1-f736-4a78-b1f5-c47d4237a948 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.401260 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.402001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.402282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.402558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] PATH_INFO: `/v3/projects/6bf0b393be514499a273f7577a17441d/users/a07ed4ffd49841a98b1c26158d82ac23/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.404675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf0b393be514499a273f7577a17441d, user_id=a07ed4ffd49841a98b1c26158d82ac23, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.407831 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.418743 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1325/2639] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:19 2022] PUT /identity/v3/projects/6bf0b393be514499a273f7577a17441d/users/a07ed4ffd49841a98b1c26158d82ac23/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:19.429888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.432919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.432919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.459652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] MFA Rules not processed for user `a07ed4ffd49841a98b1c26158d82ac23`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:19.460917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:19.553262 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1315/2640] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:19.566227 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.568536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:19.641920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214caf8b-cffc-463e-93f9-d2b0e1a78cb5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.646164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.646777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.647052 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.647321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.657199 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.659633 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92170000-8b81-4e52-aac3-19ee626f976e service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.670380 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1326/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:20.693869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:20.758466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:20.763085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9df4-968b-4760-a271-87d6e1777b8e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:20.768698 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:20.769349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:20.769635 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:20.769966 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] PATH_INFO: `/v3/users/f28dad815c5a41598de4f7ce4137eb0c` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:20.776511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28dad815c5a41598de4f7ce4137eb0c)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:20.776511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:20.964453 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28dad815c5a41598de4f7ce4137eb0c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:20.972797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28dad815c5a41598de4f7ce4137eb0c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.071688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28dad815c5a41598de4f7ce4137eb0c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.072394 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28dad815c5a41598de4f7ce4137eb0c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.085565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28dad815c5a41598de4f7ce4137eb0c'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.092082 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1316/2642] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:20 2022] DELETE /identity/v3/users/f28dad815c5a41598de4f7ce4137eb0c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:21.097516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.097996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.098296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.117656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:21.119140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.180280 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1327/2643] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:21.191082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:21.192674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.249721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaadb2d-4122-4889-b868-a0dcb4a0c966 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:21.254161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:21.254770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.255060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.255329 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.273274 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:21.282779 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:21.287242 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1317/2644] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:21.831953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:21.833669 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.848024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83b9b-5bf3-46dc-b777-cd0d1d8a6e03 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:21.852789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:21.853449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.854444 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.854750 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] PATH_INFO: `/v3/projects/f4d0146b1a9d40d18e5e573985fa35a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.856098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d0146b1a9d40d18e5e573985fa35a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:21.858565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:21.979767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:22.001442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d0146b1a9d40d18e5e573985fa35a8', 'request_id': 'req-d728cb6d-e493-486b-aeb7-a70b2307b278'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.007782 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d0146b1a9d40d18e5e573985fa35a8', 'request_id': 'req-d728cb6d-e493-486b-aeb7-a70b2307b278'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.014188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d0146b1a9d40d18e5e573985fa35a8', 'request_id': 'req-d728cb6d-e493-486b-aeb7-a70b2307b278'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.105668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] The token cache is being invalidate because project f4d0146b1a9d40d18e5e573985fa35a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:22.106317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.106835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.108366 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1328/2645] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:21 2022] DELETE /identity/v3/projects/f4d0146b1a9d40d18e5e573985fa35a8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:22.112999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.122906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d405c15-2626-4ef9-af10-99996915b201 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.181448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.182110 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.182397 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.182676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] PATH_INFO: `/v3/users/a07ed4ffd49841a98b1c26158d82ac23` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.183803 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07ed4ffd49841a98b1c26158d82ac23)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.185724 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.208009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:22.461753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07ed4ffd49841a98b1c26158d82ac23'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.468765 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07ed4ffd49841a98b1c26158d82ac23'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.624953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07ed4ffd49841a98b1c26158d82ac23'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.625562 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07ed4ffd49841a98b1c26158d82ac23'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.638168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-384f8730-6296-4b25-8faa-b0ead0dada2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07ed4ffd49841a98b1c26158d82ac23'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:22.644634 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1318/2646] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:22 2022] DELETE /identity/v3/users/a07ed4ffd49841a98b1c26158d82ac23 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:23.289598 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:23.291128 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:23.304451 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728cb6d-e493-486b-aeb7-a70b2307b278 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:23.362880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:23.363498 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.363775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.364047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] PATH_INFO: `/v3/projects/6bf0b393be514499a273f7577a17441d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.365146 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf0b393be514499a273f7577a17441d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:23.367059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:23.487314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf0b393be514499a273f7577a17441d', 'request_id': 'req-d660c6fa-4358-40b2-8415-61b7702cf327'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:23.492794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf0b393be514499a273f7577a17441d', 'request_id': 'req-d660c6fa-4358-40b2-8415-61b7702cf327'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:23.498793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf0b393be514499a273f7577a17441d', 'request_id': 'req-d660c6fa-4358-40b2-8415-61b7702cf327'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:23.624004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] The token cache is being invalidate because project 6bf0b393be514499a273f7577a17441d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:23.624291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:23.624910 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d660c6fa-4358-40b2-8415-61b7702cf327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:23.626457 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1329/2647] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:23 2022] DELETE /identity/v3/projects/6bf0b393be514499a273f7577a17441d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:23.631945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.632427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.632554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.652384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:23.653581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:23.711700 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1319/2648] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:23.720077 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.720371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.720643 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.740411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:23.741541 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:23.749326 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1330/2649] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:23.754053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:23.763646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81922ead-c14b-4683-a52b-02a2f7d6eee1 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:23.768309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:23.768902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.769191 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.769471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.770154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:23.770467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:23.772063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:23.783532 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1320/2650] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:23.787723 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:23.796853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27020fce-038a-4c63-9299-0019e1f7928c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:23.802132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:23.802719 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.802994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.803264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.803873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:23.805788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:23.917712 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1331/2651] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:23 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:23.922205 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:23.932867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1902-ab9f-4489-bddc-6fd7b18eb39c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:23.991375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:23.991915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:23.992192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:23.992463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:23.993087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:23.995067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.098456 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1321/2652] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:23 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:24.102654 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.113382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567df4-3102-47ba-993e-3d795d1f2727 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.118006 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.118597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.118876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.119168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.119807 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.121430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.131806 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1332/2653] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:24.135669 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.145628 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a002dc-6843-4750-ba31-2615019276dd admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.150313 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.150927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.151210 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.151514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.152183 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.153800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa599e37-5408-4cd9-a35d-db06890948ed admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.165180 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1322/2654] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:24.169153 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.176148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:24.179836 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4e91-fc97-4771-8eb9-d807d1fbade1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.184477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.185120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.185402 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.186376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] PATH_INFO: `/v3/projects/0bd1c8b8d0c3437abb14f2ba6ff803e8/users/7587e0b1d12749118448b22dfcf76aba/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.199973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd1c8b8d0c3437abb14f2ba6ff803e8, user_id=7587e0b1d12749118448b22dfcf76aba, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.202743 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.289199 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1333/2655] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:24 2022] PUT /identity/v3/projects/0bd1c8b8d0c3437abb14f2ba6ff803e8/users/7587e0b1d12749118448b22dfcf76aba/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:24.301256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.301546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.301819 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.310269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:24.330050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] MFA Rules not processed for user `7587e0b1d12749118448b22dfcf76aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:24.331315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:24.398196 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1323/2656] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:24.402775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.466436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df445981-bf47-4f9e-82d1-33b0a7b8a2ef admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.471165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.472258 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.472597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.472872 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.477138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.477138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.551345 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1334/2657] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:24 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:24.555559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.566297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f542b-6a69-42ee-8f50-ff43e6f5c290 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.621806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.622425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.622705 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.622978 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.623605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.625523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.686716 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1324/2658] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:24 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:24.690917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.701376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dedf0f-9edc-40a4-8d9a-84cfd412b80f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.706551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.707129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.707409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.707685 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.708332 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.709970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.720998 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1335/2659] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:24.725917 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.736005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32f4a1-ddd0-40d1-93b4-fe556b72a5c3 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.740964 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.741607 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.741938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.742223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] PATH_INFO: `/v3/projects/a4e28a3689e94b28ab46edbedc10c997/users/a8213a484e0b467087474ce23b04afbf/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.757012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e28a3689e94b28ab46edbedc10c997, user_id=a8213a484e0b467087474ce23b04afbf, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.759752 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.823198 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1325/2660] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:24 2022] PUT /identity/v3/projects/a4e28a3689e94b28ab46edbedc10c997/users/a8213a484e0b467087474ce23b04afbf/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:24.827111 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.838368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fbe21-7db3-4150-8823-8b3d29e836ed admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.894187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.894820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.895101 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.895376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.896014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.897602 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a7942-6902-49ed-ac56-dda51ed0b87c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.906980 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1336/2661] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:24.911193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.921532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76659f-8a63-4f38-b181-10f211628417 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.926506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.927148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.927429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.927704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] PATH_INFO: `/v3/projects/a4e28a3689e94b28ab46edbedc10c997/users/a8213a484e0b467087474ce23b04afbf/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.929592 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e28a3689e94b28ab46edbedc10c997, user_id=a8213a484e0b467087474ce23b04afbf, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.932285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.942851 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1326/2662] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:24 2022] PUT /identity/v3/projects/a4e28a3689e94b28ab46edbedc10c997/users/a8213a484e0b467087474ce23b04afbf/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:27:24.953200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.953518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.953799 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.982275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] MFA Rules not processed for user `a8213a484e0b467087474ce23b04afbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:24.983484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:25.022560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:25.049981 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1337/2663] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:25.060686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:25.062477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:25.115294 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:25.120414 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964aa3-345b-4edc-92e1-2a5116e8f01c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:25.124187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:25.124677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:25.124959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:25.125234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:25.134620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:25.136128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:25.146617 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1327/2664] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:25.192513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:25.193900 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:25.206310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75806ed2-bc0e-4066-931b-59c7bed6dd61 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:25.210001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:25.210600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:25.210880 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:25.211155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:25.265875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:25.267327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:25.276213 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1338/2665] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:29.329222 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:29.330727 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:29.389577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c137be-a32a-439a-86eb-77c525d50ba8 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:29.393179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:29.393782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:29.394123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:29.395095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:29.396912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:29.406659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:29.408095 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da04e90-3acb-41cf-a313-7e6793466225 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:29.416742 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1328/2666] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:30.231870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:30.296790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bcabd-9e18-418e-ba9e-8f1985ad2205 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:30.301519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:30.302176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.302454 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.302757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] PATH_INFO: `/v3/users/7587e0b1d12749118448b22dfcf76aba` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.303936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7587e0b1d12749118448b22dfcf76aba)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:30.305860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:30.534707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7587e0b1d12749118448b22dfcf76aba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.607007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7587e0b1d12749118448b22dfcf76aba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.614758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7587e0b1d12749118448b22dfcf76aba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.615395 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7587e0b1d12749118448b22dfcf76aba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.625254 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:30.627149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7587e0b1d12749118448b22dfcf76aba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.633556 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1339/2667] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:30 2022] DELETE /identity/v3/users/7587e0b1d12749118448b22dfcf76aba => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:30.638075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.644073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.644073 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.657645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:30.658898 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:30.719034 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1329/2668] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:30.728813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:30.730296 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:30.787527 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c38e7-db54-4b21-89ce-62f4e5a3bda9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:30.791544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:30.792144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.792450 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.792721 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.802253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:30.803690 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:30.813030 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1340/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:31.172218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:31.172218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:31.184958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3977-dac3-4771-8b16-373f25ec3957 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:31.190075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:31.190723 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:31.191005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:31.191299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] PATH_INFO: `/v3/projects/0bd1c8b8d0c3437abb14f2ba6ff803e8` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:31.192643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd1c8b8d0c3437abb14f2ba6ff803e8)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:31.194797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:31.365252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd1c8b8d0c3437abb14f2ba6ff803e8', 'request_id': 'req-d91112b7-e076-4add-b28a-205bbc93e122'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.371127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd1c8b8d0c3437abb14f2ba6ff803e8', 'request_id': 'req-d91112b7-e076-4add-b28a-205bbc93e122'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.377860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd1c8b8d0c3437abb14f2ba6ff803e8', 'request_id': 'req-d91112b7-e076-4add-b28a-205bbc93e122'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.459006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] The token cache is being invalidate because project 0bd1c8b8d0c3437abb14f2ba6ff803e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:31.459302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.459958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.461494 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1330/2670] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:31 2022] DELETE /identity/v3/projects/0bd1c8b8d0c3437abb14f2ba6ff803e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:31.465705 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:31.475958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae518c9e-284b-47bd-8248-0a9bf405c0d1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:31.538109 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:31.538739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:31.539020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:31.539291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] PATH_INFO: `/v3/users/a8213a484e0b467087474ce23b04afbf` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:31.540446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8213a484e0b467087474ce23b04afbf)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:31.542360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:31.799104 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8213a484e0b467087474ce23b04afbf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.893439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8213a484e0b467087474ce23b04afbf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.901730 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8213a484e0b467087474ce23b04afbf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.902562 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8213a484e0b467087474ce23b04afbf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.915800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3ad48eb4-23ea-4cf4-bcca-367fe8b58055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8213a484e0b467087474ce23b04afbf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:31.921688 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1341/2671] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:31 2022] DELETE /identity/v3/users/a8213a484e0b467087474ce23b04afbf => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:32.418070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:32.418070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:32.428946 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91112b7-e076-4add-b28a-205bbc93e122 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:32.442150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:32.486193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:32.486813 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:32.487093 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:32.487368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] PATH_INFO: `/v3/projects/a4e28a3689e94b28ab46edbedc10c997` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:32.489377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e28a3689e94b28ab46edbedc10c997)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:32.491407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:32.619959 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e28a3689e94b28ab46edbedc10c997', 'request_id': 'req-5270a8ed-0271-4daa-9dd2-add74e5108b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:32.631864 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e28a3689e94b28ab46edbedc10c997', 'request_id': 'req-5270a8ed-0271-4daa-9dd2-add74e5108b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:32.638506 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e28a3689e94b28ab46edbedc10c997', 'request_id': 'req-5270a8ed-0271-4daa-9dd2-add74e5108b8'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:32.709300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] The token cache is being invalidate because project a4e28a3689e94b28ab46edbedc10c997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:32.709703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:32.710912 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5270a8ed-0271-4daa-9dd2-add74e5108b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:32.712721 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1331/2672] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:32 2022] DELETE /identity/v3/projects/a4e28a3689e94b28ab46edbedc10c997 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:32.717566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:32.718068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:32.718162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:32.738172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:32.739449 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:32.748753 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:32.797789 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1342/2673] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:32.805902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:32.806193 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:32.806471 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:32.825661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:32.826914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:32.835765 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1332/2674] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:32.840342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:32.850870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcda32-58b2-46d5-8eb5-ba66fe4c591c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:32.855436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:32.856044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:32.856327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:32.856599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:32.857234 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:32.857536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:32.859161 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:32.870469 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1343/2675] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:32.874845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:32.884596 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e5e0-d7a3-4644-9934-afc4c35e0b92 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:32.889357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:32.889984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:32.890270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:32.890546 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:32.891170 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:32.893113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.009024 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1333/2676] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:32 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:33.012913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.023546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b995-0e55-40ba-97c6-22f1ba1c4c24 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.083835 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.084433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.084715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.084988 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.085611 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.087813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.207769 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1344/2677] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:33 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:33.211940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.222502 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1e41-629a-4fbd-a3f7-bdd25c6b8076 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.227492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.228082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.228362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.228659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.229461 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.231165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.241243 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1334/2678] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:33.245242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.256273 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b9268-cbc6-4862-8759-07cd98a75e2a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.260873 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.261461 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.261744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.262051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.262686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.264286 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34eb39-388d-42be-9f5d-9598efbea58c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.276050 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1345/2679] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:33.280139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.290062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ceca2-c9b5-40cd-b70b-cb722b083cfe admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.294449 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.295083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.295364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.295638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] PATH_INFO: `/v3/projects/03745671f4154fa9825e2fb053e776fa/users/0309880f18844ec79ac82b71ae1631d6/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.310178 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03745671f4154fa9825e2fb053e776fa, user_id=0309880f18844ec79ac82b71ae1631d6, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.312820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.402567 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1335/2680] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:33 2022] PUT /identity/v3/projects/03745671f4154fa9825e2fb053e776fa/users/0309880f18844ec79ac82b71ae1631d6/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:33.414277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.414587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.414862 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.442805 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] MFA Rules not processed for user `0309880f18844ec79ac82b71ae1631d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:33.444017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:33.508634 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1346/2681] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:33.522120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.569581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:33.586303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c1b4-6bd6-41d4-8248-dde4cb89fe05 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.591309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.591906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.592185 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.592457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.593080 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.595251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.751400 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1336/2682] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:33 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:33.756292 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.766882 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49729-4f75-4f55-a4db-fe88c96a87d5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.774722 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:33.823097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.823696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.823974 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.824248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.824861 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.827003 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.933383 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1347/2683] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:33 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:33.937448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.947853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4ac4-f0cd-4fa4-ad12-862883a56f10 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.952725 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.953332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.953636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.954154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.955004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.956975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.967548 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1337/2684] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:33.971702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.983341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb1a-955f-4cbc-bbfc-222207e3fc72 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.988050 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.988886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.989646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.989952 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] PATH_INFO: `/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4/users/0a11ecc251d5429ba6de9a3449746eee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.005537 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd06b20ff1cc4b48a128c17d42e5d8c4, user_id=0a11ecc251d5429ba6de9a3449746eee, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:34.008264 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:34.086430 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1348/2685] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:33 2022] PUT /identity/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4/users/0a11ecc251d5429ba6de9a3449746eee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:34.090768 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:34.101424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265a280-cc9f-4342-8bba-a30ba3572688 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:34.174554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:34.175177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:34.175454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:34.175766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.177269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:34.178915 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f89c4-7b74-4719-9f50-c43ddafc89ab admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:34.188540 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1338/2686] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:34.192704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:34.202985 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8aa2-8eae-4c5b-a5cd-433d889c7aec admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:34.208277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:34.208934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:34.209248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:34.209509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] PATH_INFO: `/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4/users/0a11ecc251d5429ba6de9a3449746eee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.211501 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd06b20ff1cc4b48a128c17d42e5d8c4, user_id=0a11ecc251d5429ba6de9a3449746eee, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:34.214436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:34.226152 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1349/2687] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:34 2022] PUT /identity/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4/users/0a11ecc251d5429ba6de9a3449746eee/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:34.236674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:34.236965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:34.237265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.266716 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] MFA Rules not processed for user `0a11ecc251d5429ba6de9a3449746eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:34.267925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:34.336333 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1339/2688] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:34.347255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:34.349139 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:34.408048 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e63c6-af7c-4d6d-94e8-40de5c553da9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:34.412230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:34.412916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:34.413200 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:34.413481 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.423057 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:34.424538 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b7fe4-85d8-4d52-9c06-555e64b43e5f service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:34.435641 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1350/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:34.585088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:34.627076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:34.647825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd0ea-c0e4-4d01-9511-8781f046d0fa None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:34.652458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:34.653075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:34.653361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:34.653633 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] PATH_INFO: `/v3/users/0309880f18844ec79ac82b71ae1631d6` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:34.654761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0309880f18844ec79ac82b71ae1631d6)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:34.656661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:34.906267 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0309880f18844ec79ac82b71ae1631d6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:34.913958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0309880f18844ec79ac82b71ae1631d6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:34.990702 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0309880f18844ec79ac82b71ae1631d6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:34.991323 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0309880f18844ec79ac82b71ae1631d6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.003911 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0309880f18844ec79ac82b71ae1631d6'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.009701 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1340/2690] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:34 2022] DELETE /identity/v3/users/0309880f18844ec79ac82b71ae1631d6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:35.014192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808569a-546f-428b-bb66-530a315b5f64 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.014656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808569a-546f-428b-bb66-530a315b5f64 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.014755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808569a-546f-428b-bb66-530a315b5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.033504 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9808569a-546f-428b-bb66-530a315b5f64 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:35.034737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9808569a-546f-428b-bb66-530a315b5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.094263 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1351/2691] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:35.104738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:35.106262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.167835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091dcf-7cca-4cb4-8f7c-10fecfcdd0ff admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:35.171256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:35.171850 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.172130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.172517 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.182226 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:35.183733 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:35.194158 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1341/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:35.321300 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.321623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.321934 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.335607 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:35.341881 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:35.343121 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.351847 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1352/2693] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:35.372221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:35.373999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.436159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:35.453012 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27f26-09d4-4096-93b1-b46b309f6936 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:35.458938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:35.459542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.459838 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.460114 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.468776 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:35.470413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:35.481120 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1342/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:35.609195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:35.610812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.625360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd002-172a-4757-8ef4-484bc7d53eb8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:35.630059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:35.630688 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.630970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.631737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] PATH_INFO: `/v3/projects/03745671f4154fa9825e2fb053e776fa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.632994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03745671f4154fa9825e2fb053e776fa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:35.635079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:35.786026 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03745671f4154fa9825e2fb053e776fa', 'request_id': 'req-5d11d218-9467-49e7-90d0-e00d84ff4738'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.791666 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03745671f4154fa9825e2fb053e776fa', 'request_id': 'req-5d11d218-9467-49e7-90d0-e00d84ff4738'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.797789 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03745671f4154fa9825e2fb053e776fa', 'request_id': 'req-5d11d218-9467-49e7-90d0-e00d84ff4738'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.886614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] The token cache is being invalidate because project 03745671f4154fa9825e2fb053e776fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:35.886914 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.887588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.889116 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1353/2695] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:35 2022] DELETE /identity/v3/projects/03745671f4154fa9825e2fb053e776fa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:35.893030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:35.903988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ca63-4bd8-4a1e-813e-5f634ac7942f service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:35.961463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:35.962356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.962647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.962923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] PATH_INFO: `/v3/users/0a11ecc251d5429ba6de9a3449746eee` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.964031 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a11ecc251d5429ba6de9a3449746eee)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:35.965975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:36.186577 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a11ecc251d5429ba6de9a3449746eee'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.194496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a11ecc251d5429ba6de9a3449746eee'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.315713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a11ecc251d5429ba6de9a3449746eee'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.316835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a11ecc251d5429ba6de9a3449746eee'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.328804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-1bf46e35-bc67-413e-9c85-010b66dd0978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a11ecc251d5429ba6de9a3449746eee'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.335281 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1343/2696] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:35 2022] DELETE /identity/v3/users/0a11ecc251d5429ba6de9a3449746eee => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:36.768834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:36.771198 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:36.791576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d218-9467-49e7-90d0-e00d84ff4738 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:36.848986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:36.849613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:36.849931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:36.850202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] PATH_INFO: `/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:36.851312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd06b20ff1cc4b48a128c17d42e5d8c4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:36.853341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:36.994062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd06b20ff1cc4b48a128c17d42e5d8c4', 'request_id': 'req-9ebe09c1-4690-4297-820e-66fa29cb6122'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.999641 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd06b20ff1cc4b48a128c17d42e5d8c4', 'request_id': 'req-9ebe09c1-4690-4297-820e-66fa29cb6122'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:37.006414 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd06b20ff1cc4b48a128c17d42e5d8c4', 'request_id': 'req-9ebe09c1-4690-4297-820e-66fa29cb6122'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:37.092983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] The token cache is being invalidate because project dd06b20ff1cc4b48a128c17d42e5d8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:37.093278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:37.093931 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9ebe09c1-4690-4297-820e-66fa29cb6122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:37.096226 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1354/2697] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:36 2022] DELETE /identity/v3/projects/dd06b20ff1cc4b48a128c17d42e5d8c4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:37.100380 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.100880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.100991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.120764 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:37.124939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:37.182313 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1344/2698] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:37.190908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.191204 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.192036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.212627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:37.213884 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:37.221761 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1355/2699] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:37.226106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.236307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:37.241033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44f8e-61b1-4da2-9681-5f3f5c281469 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.245761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.246389 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.246677 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.246954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.247597 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:37.247906 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.249514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.262133 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1345/2700] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:37.266488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.276063 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf99fca-9ed4-4786-bc8b-e5201ab0dad2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.280995 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.281534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.281825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.282155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.282795 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.284720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.289406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:37.408634 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1356/2701] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/projects => generated 407 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:37.413089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.423158 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad74f9-20e4-4774-8600-cc57bfd6c18a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.478659 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.479281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.479566 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.479847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.480479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.482641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.641466 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1346/2702] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/users => generated 304 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:37.645429 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.655853 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f3f27-1f7e-4745-ba7c-c64127365737 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.661532 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.662160 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.662441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.662746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.663423 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.664997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.674525 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1357/2703] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:37.679320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.689408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342da91-f3f6-4efa-b0f2-89f0278f3d81 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.698970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.698970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.698970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.698970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.699402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.699402 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb995f4-1c23-49a3-af4c-02d7b4fad8ff admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.708489 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1347/2704] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:37.712756 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.723446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876f37-e5d9-4607-af62-4aa9bd3f4d96 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.728158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.728804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.729088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.729364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] PATH_INFO: `/v3/projects/85d80dde068b4a039a58b022b2bd7cd3/users/f24932ba4aed404dbc5b5ce2da93cf96/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.744021 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d80dde068b4a039a58b022b2bd7cd3, user_id=f24932ba4aed404dbc5b5ce2da93cf96, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.746738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.842147 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1358/2705] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:37 2022] PUT /identity/v3/projects/85d80dde068b4a039a58b022b2bd7cd3/users/f24932ba4aed404dbc5b5ce2da93cf96/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:37.857667 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.857990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.858270 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.888016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] MFA Rules not processed for user `f24932ba4aed404dbc5b5ce2da93cf96`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:37.889232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:37.952580 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1348/2706] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:37.957745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.027662 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a43f-11f0-4c40-a45d-1e3b437d6210 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.033075 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.033678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.033994 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.034294 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.035842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.037987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.466502 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1359/2707] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/projects => generated 409 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:38.470673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.481512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a137e7d-4883-4691-8ae1-af73057dcfe6 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.536866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.537466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.537746 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.538047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.538674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.540590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.548234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:38.641416 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1349/2708] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:38 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:38.646188 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.656554 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ad5a-eb6c-4263-a05b-7d0f197d2114 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.661307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.661922 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.662212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.662487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.663269 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.664916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.676444 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1360/2709] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:38.680684 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.690441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d858bf-6429-49e6-8297-7d26901ff02c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.695676 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.696314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.696673 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.696950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] PATH_INFO: `/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6/users/74bec12342834d2d886e43d35161dbe9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.711957 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c290a3c7d58466f8a50a2e786a6f4e6, user_id=74bec12342834d2d886e43d35161dbe9, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.714902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.784228 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1350/2710] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:38 2022] PUT /identity/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6/users/74bec12342834d2d886e43d35161dbe9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:38.788325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.798256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b810f8-6b48-44ff-a6ff-d05d25341847 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.853503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.854203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.854406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.854677 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.855310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.856960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bfed5-29c5-4b7b-9f4d-5df20f1f77b2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.867178 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1361/2711] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:38.871429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.882522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403b89d-2476-44eb-a682-7e3ba65b2a79 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:38.887330 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:38.887973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.888282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.888557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] PATH_INFO: `/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6/users/74bec12342834d2d886e43d35161dbe9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.890478 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c290a3c7d58466f8a50a2e786a6f4e6, user_id=74bec12342834d2d886e43d35161dbe9, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:38.893089 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:38.903588 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1351/2712] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:38 2022] PUT /identity/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6/users/74bec12342834d2d886e43d35161dbe9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:38.914033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.914353 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.914648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.942397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] MFA Rules not processed for user `74bec12342834d2d886e43d35161dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:38.943599 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:38.951759 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:39.011145 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1362/2713] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:39.022774 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:39.024466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:39.083160 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8c56-ad0e-45f4-8cd5-0d005ffcf0ba admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:39.086841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:39.087873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.088159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.088494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.098055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:39.099492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb6446-b641-40a3-95af-61f8187f809a service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:39.109092 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1352/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:39.470008 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:39.471965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda6e6-bda0-400d-b814-bd2efde56084 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:39.476327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:39.477014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.477360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.477701 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.534775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:39.536346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:39.545168 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1363/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:39.916085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093587-6c9b-4af8-96ba-a42ac9bb8f1a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.916568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093587-6c9b-4af8-96ba-a42ac9bb8f1a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.916670 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093587-6c9b-4af8-96ba-a42ac9bb8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.936532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a0093587-6c9b-4af8-96ba-a42ac9bb8f1a None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:39.937787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a0093587-6c9b-4af8-96ba-a42ac9bb8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:39.997749 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1353/2716] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:40.017116 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:40.018886 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:40.093098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8078-c95b-49e4-b950-8e2493b4be21 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:40.105271 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:40.106151 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:40.106432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:40.106758 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:40.117312 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:40.118940 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:40.129861 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1364/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:43.824598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:43.825133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:43.825315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:43.845307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:43.846541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:43.854694 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1354/2718] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:43.876943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:43.878373 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:43.893566 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d5f0-bccc-4535-89d5-67a7e9305643 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:43.899973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:43.900569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:43.900856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:43.901130 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:43.909406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:43.911275 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89c65-1a89-4913-9a42-916d2b39e068 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:43.920845 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1365/2719] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:47.673006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:47.683624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf727-4db8-4dcc-ad42-b5dad6e04c9b None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:47.688196 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:47.688816 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.689100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.689377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] PATH_INFO: `/v3/users/f24932ba4aed404dbc5b5ce2da93cf96` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.690503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24932ba4aed404dbc5b5ce2da93cf96)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:47.692505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:47.829459 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:INSERT=5,keystone:SELECT=89,keystone:DELETE=6 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:47.832793 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24932ba4aed404dbc5b5ce2da93cf96'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.839817 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24932ba4aed404dbc5b5ce2da93cf96'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.921441 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24932ba4aed404dbc5b5ce2da93cf96'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.922139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24932ba4aed404dbc5b5ce2da93cf96'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.935578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24932ba4aed404dbc5b5ce2da93cf96'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.941704 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1355/2720] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:47 2022] DELETE /identity/v3/users/f24932ba4aed404dbc5b5ce2da93cf96 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:47.946231 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45b-eed1-4153-affe-72e0eddf2950 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.946715 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45b-eed1-4153-affe-72e0eddf2950 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.946816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45b-eed1-4153-affe-72e0eddf2950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.965960 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-eb0dd45b-eed1-4153-affe-72e0eddf2950 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:47.967144 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-eb0dd45b-eed1-4153-affe-72e0eddf2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:47.977226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:48.027848 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1366/2721] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:48.038385 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.039847 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.055142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.055426 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.055702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.074954 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:48.076142 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.083879 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1367/2722] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:48.098058 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f6243-b9ee-4309-b3d1-13e33dc791ec admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.102013 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.102364 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.102647 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.102925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.107242 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.108605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.112491 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.114742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.124563 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1356/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:48.185793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f090-cc60-47ec-889a-543e109e3363 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.191808 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.192678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.193097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.193519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.202206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.203797 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.214338 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1368/2724] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:48.534692 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.543111 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.550115 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335cf9-af43-46de-bc90-9b6ce919a28a service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.555103 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.556262 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.556717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.557003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] PATH_INFO: `/v3/projects/85d80dde068b4a039a58b022b2bd7cd3` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.558159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d80dde068b4a039a58b022b2bd7cd3)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.560057 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.743256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d80dde068b4a039a58b022b2bd7cd3', 'request_id': 'req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:48.748703 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d80dde068b4a039a58b022b2bd7cd3', 'request_id': 'req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:48.755165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d80dde068b4a039a58b022b2bd7cd3', 'request_id': 'req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:48.823083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] The token cache is being invalidate because project 85d80dde068b4a039a58b022b2bd7cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:48.823301 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:48.823921 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:48.825402 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1357/2725] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:48 2022] DELETE /identity/v3/projects/85d80dde068b4a039a58b022b2bd7cd3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:48.829384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.839783 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58211e3-a20d-4e6b-9649-34bf5d3ff219 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.893419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.894065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.894932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.895206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] PATH_INFO: `/v3/users/74bec12342834d2d886e43d35161dbe9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.896310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74bec12342834d2d886e43d35161dbe9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.898259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:49.080845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:49.089608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74bec12342834d2d886e43d35161dbe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.161143 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74bec12342834d2d886e43d35161dbe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.168371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74bec12342834d2d886e43d35161dbe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.169014 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74bec12342834d2d886e43d35161dbe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.180738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a30995e6-e042-4234-9b05-176abe0e4213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74bec12342834d2d886e43d35161dbe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.187365 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1369/2726] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:48 2022] DELETE /identity/v3/users/74bec12342834d2d886e43d35161dbe9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:49.596234 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:49.598318 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:49.611533 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8ea70-11d6-4ccb-93b9-11e28aeedc0d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:49.658120 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:49.671304 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:49.671929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:49.672211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:49.672484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] PATH_INFO: `/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:49.673598 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c290a3c7d58466f8a50a2e786a6f4e6)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:49.676309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:49.842037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c290a3c7d58466f8a50a2e786a6f4e6', 'request_id': 'req-5d03353b-09fd-49ba-ba80-66427359fa64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.848053 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c290a3c7d58466f8a50a2e786a6f4e6', 'request_id': 'req-5d03353b-09fd-49ba-ba80-66427359fa64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.854187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c290a3c7d58466f8a50a2e786a6f4e6', 'request_id': 'req-5d03353b-09fd-49ba-ba80-66427359fa64'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.920122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] The token cache is being invalidate because project 6c290a3c7d58466f8a50a2e786a6f4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:49.920411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.921025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5d03353b-09fd-49ba-ba80-66427359fa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:49.922569 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1358/2727] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:49 2022] DELETE /identity/v3/projects/6c290a3c7d58466f8a50a2e786a6f4e6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:49.928090 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:49.928379 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:49.928657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:49.948664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:49.949870 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:50.009418 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1370/2728] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:50.073856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.074144 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.074447 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.094718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:50.095933 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:50.104788 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1359/2729] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:50.109045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.120037 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6faa7c-cd51-4d41-8dc1-090d2a4cb745 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.124680 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.125282 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.125564 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.125852 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.126686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:50.126897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.128455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.140568 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1371/2730] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:50.148446 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.158216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091f75d-1e46-4a44-b503-d602e7ed60e9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.164211 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.164825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.165096 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.165369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.166085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.168542 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.294164 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1360/2731] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:50.298410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.308875 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311e1e-ee43-4b0d-8ab6-a91c4e7630ed admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.364277 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.364908 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.365196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.365488 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.366217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.368243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.464637 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1372/2732] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:50.468758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.479180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ffb63-08c9-4762-ab3e-e86064ca57e1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.483721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.484306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.484588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.484865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.485507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.487174 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.496988 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1361/2733] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:50.501005 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.511618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed158e-6a36-41bd-a9d1-7497e394fa43 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.516360 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.516943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.517320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.517497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.518164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.520464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5af5-a33e-4981-9448-063b59721290 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.530912 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1373/2734] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:50.535206 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.545306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e7b-fefb-4ba7-8c3e-bc5d6c62177a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.549790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.550463 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.550744 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.551019 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] PATH_INFO: `/v3/projects/fdd64db662b44152aa462cbf2929d45e/users/5f188f8f5325469b94af5409603c92b3/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.565159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd64db662b44152aa462cbf2929d45e, user_id=5f188f8f5325469b94af5409603c92b3, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.568335 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.642712 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1362/2735] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:50 2022] PUT /identity/v3/projects/fdd64db662b44152aa462cbf2929d45e/users/5f188f8f5325469b94af5409603c92b3/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:50.653452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.653738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.654040 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.680770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] MFA Rules not processed for user `5f188f8f5325469b94af5409603c92b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:50.682155 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:50.690020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:50.747743 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1374/2736] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:50.752200 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.817507 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c7f2-c576-4bcf-bd54-221dfc4d7d8d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.822179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.822781 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.823064 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.823343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.823972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.826085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.932904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:50.940032 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1363/2737] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:50.945051 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:50.955590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071900-63c5-45e3-add9-bdb05f93849a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.171158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.171158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.171158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.171158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.173298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.173298 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.252368 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1375/2738] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:50 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:51.257540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.269691 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df372b83-8f17-4269-9676-feaad3dc5993 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.274316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.274910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.275192 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.275473 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.276113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.277697 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.289197 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1364/2739] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:51.293325 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.304045 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadb63a-6138-4735-8eb3-fc58f60cbd5b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.308565 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.309183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.309469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.309749 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] PATH_INFO: `/v3/projects/bdf010cb517a4e00bf1ab030e374dbca/users/85a0afb13864407ba770034991b77642/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.324490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf010cb517a4e00bf1ab030e374dbca, user_id=85a0afb13864407ba770034991b77642, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.328704 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.401811 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1376/2740] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:51 2022] PUT /identity/v3/projects/bdf010cb517a4e00bf1ab030e374dbca/users/85a0afb13864407ba770034991b77642/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:51.405958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.416971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0227-9ab4-4505-bfd6-9b3311a96e61 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.475201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.475715 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.475997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.476271 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.476904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.478554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4298-ad43-4b58-8c19-867134a2fd42 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.488301 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1365/2741] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:51.492822 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.502897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bda930-912b-4d93-b5c6-aa6771136d49 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.507405 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.508038 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.508317 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.508587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] PATH_INFO: `/v3/projects/bdf010cb517a4e00bf1ab030e374dbca/users/85a0afb13864407ba770034991b77642/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.510514 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf010cb517a4e00bf1ab030e374dbca, user_id=85a0afb13864407ba770034991b77642, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.513127 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.523965 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1377/2742] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:51 2022] PUT /identity/v3/projects/bdf010cb517a4e00bf1ab030e374dbca/users/85a0afb13864407ba770034991b77642/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:27:51.534363 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.534782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.535714 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.563761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] MFA Rules not processed for user `85a0afb13864407ba770034991b77642`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:51.565028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:51.632928 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1366/2743] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:51.646516 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.648230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:51.706034 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09a85-83ea-4753-a0fe-d1b01d7db5ea admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.710371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.710968 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.711253 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.711529 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.720911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.722967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f429ff-8f9b-4617-88a3-6605daef9cc7 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.732692 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1378/2744] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:51.866593 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:51.876184 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5003e-34be-4778-a579-e70922768dc4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:51.880499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:51.881097 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:51.881382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:51.881657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:51.937603 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:51.939086 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:51.948601 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1367/2745] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:52.326107 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:52.326659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:52.326659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:52.335587 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:52.346310 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:52.347606 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:52.406348 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1379/2746] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Aug 7 01:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:52.432518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:52.433028 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:52.434069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:52.443686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c703f2-b2d2-4521-a65a-64fe4e2be5e5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:52.444790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=100 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:52.448552 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:52.449185 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:52.449469 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:52.449765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] PATH_INFO: `/v3/users/5f188f8f5325469b94af5409603c92b3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:52.450970 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f188f8f5325469b94af5409603c92b3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:52.452897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:52.511357 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8a28-ea79-4aae-9a00-7275aefaafc6 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:52.516802 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:52.517424 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:52.517709 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:52.518022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:52.526582 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:52.528172 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486fcb-f492-4899-bd5e-b33134361ee0 service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:52.537750 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1368/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:52.637228 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f188f8f5325469b94af5409603c92b3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:52.703241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f188f8f5325469b94af5409603c92b3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:52.710929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f188f8f5325469b94af5409603c92b3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:52.711579 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f188f8f5325469b94af5409603c92b3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:52.724315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f188f8f5325469b94af5409603c92b3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:52.730494 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1380/2748] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:52 2022] DELETE /identity/v3/users/5f188f8f5325469b94af5409603c92b3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:27:52.734950 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:52.735239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:52.735519 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:52.755641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:52.756829 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:52.813977 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1369/2749] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:52.823848 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:52.825237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:52.881044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aab98-74b7-4081-af18-efba40afb2fc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:52.884678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:52.885267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:52.885549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:52.885816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:52.894616 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:52.896115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:52.905392 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1381/2750] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:53.323379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:53.324867 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:53.337907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e886c-c0ca-4718-a6c6-5da1b368a9e9 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:53.342769 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:53.343468 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:53.343754 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:53.344028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] PATH_INFO: `/v3/projects/fdd64db662b44152aa462cbf2929d45e` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:53.345156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd64db662b44152aa462cbf2929d45e)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:53.347167 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:53.459830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd64db662b44152aa462cbf2929d45e', 'request_id': 'req-2e6fa20c-7b4b-43fa-8af1-3bb940614046'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.465469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd64db662b44152aa462cbf2929d45e', 'request_id': 'req-2e6fa20c-7b4b-43fa-8af1-3bb940614046'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.471668 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd64db662b44152aa462cbf2929d45e', 'request_id': 'req-2e6fa20c-7b4b-43fa-8af1-3bb940614046'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.583942 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] The token cache is being invalidate because project fdd64db662b44152aa462cbf2929d45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:53.584236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.584904 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.586446 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1370/2751] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:53 2022] DELETE /identity/v3/projects/fdd64db662b44152aa462cbf2929d45e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:53.590793 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:53.602157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5d754-c37b-4c9d-964f-da4da587860d service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:53.618958 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:53.657047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:53.657668 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:53.657971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:53.658246 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] PATH_INFO: `/v3/users/85a0afb13864407ba770034991b77642` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:53.659344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a0afb13864407ba770034991b77642)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:53.661387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:53.831192 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a0afb13864407ba770034991b77642'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.898364 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a0afb13864407ba770034991b77642'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.905452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a0afb13864407ba770034991b77642'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.906102 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a0afb13864407ba770034991b77642'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.918226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c51c557c-cb29-4edd-9f2a-ff7531371307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a0afb13864407ba770034991b77642'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:53.924234 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1382/2752] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:53 2022] DELETE /identity/v3/users/85a0afb13864407ba770034991b77642 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:54.322127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:54.323658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:54.343142 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa20c-7b4b-43fa-8af1-3bb940614046 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:54.356971 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:54.402450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:54.403003 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.403283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.403558 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] PATH_INFO: `/v3/projects/bdf010cb517a4e00bf1ab030e374dbca` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.404674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf010cb517a4e00bf1ab030e374dbca)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:54.406624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:54.538148 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf010cb517a4e00bf1ab030e374dbca', 'request_id': 'req-e01ba51d-4c30-40b6-8fcd-c69a30f61357'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:54.543466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf010cb517a4e00bf1ab030e374dbca', 'request_id': 'req-e01ba51d-4c30-40b6-8fcd-c69a30f61357'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:54.549492 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf010cb517a4e00bf1ab030e374dbca', 'request_id': 'req-e01ba51d-4c30-40b6-8fcd-c69a30f61357'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:54.616782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] The token cache is being invalidate because project bdf010cb517a4e00bf1ab030e374dbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:54.617074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:54.617704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-e01ba51d-4c30-40b6-8fcd-c69a30f61357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:54.619223 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1371/2753] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:54 2022] DELETE /identity/v3/projects/bdf010cb517a4e00bf1ab030e374dbca => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:54.624072 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.624521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.624627 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.644583 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:54.645819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:54.703662 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1383/2754] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:54.712288 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.712849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.713104 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.735503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:54.736783 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:54.745011 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1372/2755] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:54.749442 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:54.759850 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad363f-7b47-4a2c-9441-1245f3babba9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:54.764476 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:54.765080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.765452 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.765720 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.766397 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:54.766711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:54.768318 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:54.780945 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1384/2756] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:54.785967 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:54.795496 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416ccb8-4411-4df2-a1a4-ff6bc841c92e None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:54.800284 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:54.801939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.801939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.801939 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.802718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:54.804009 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:54.888825 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1373/2757] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:54 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:54.892858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:54.903790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5b88a-ca1f-4d4c-83ea-f9af63a60a73 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:54.927548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:54.962608 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:54.963281 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.963561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.963830 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.964445 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:54.966431 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.047442 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1385/2758] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:54 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:55.051792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:55.061801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19dece-2443-4585-b567-b77fa0b4c271 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:55.067499 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:55.068131 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.068643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.068930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.069583 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:55.071307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.082724 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1374/2759] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:55.086733 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:55.096674 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490959b-34d9-481d-aa79-469e7f427dc6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:55.101386 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:55.102012 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.108249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.108249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.108249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:55.108249 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee144e-b802-4d69-b2a3-92a8c01817fb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.114414 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1386/2760] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:55.118466 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:55.128503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ed3e-2c15-41c5-99f3-34f512a31e70 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:55.133567 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:55.134235 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.134515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.134789 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] PATH_INFO: `/v3/projects/3c32482781d74b5e9d3d7098262d0823/users/7e2d30768bc24ed7940b284848f9717b/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.149244 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c32482781d74b5e9d3d7098262d0823, user_id=7e2d30768bc24ed7940b284848f9717b, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:55.151922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.263802 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1375/2761] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:55 2022] PUT /identity/v3/projects/3c32482781d74b5e9d3d7098262d0823/users/7e2d30768bc24ed7940b284848f9717b/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:55.275108 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.275394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.275667 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.303302 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] MFA Rules not processed for user `7e2d30768bc24ed7940b284848f9717b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:55.304518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:55.367217 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1387/2762] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:55.378531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:55.380963 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:55.425616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:55.458514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0c259-8c6e-4061-ba96-b45d734d6a41 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:55.462295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37ad903b3fcf4e1f90c6c8d2c716d3f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:55.463246 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.463600 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.463954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.472503 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:55.474038 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a717bf-33a3-4f25-8254-af81e584643a service glance] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.483454 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1376/2763] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:05.064972 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:05.067239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:05.205655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3643c-dcd2-4926-ad92-c98a090a77b0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:05.205655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47047e63-020a-489f-8393-86259d292186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:05.205655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47047e63-020a-489f-8393-86259d292186 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:05.205655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47047e63-020a-489f-8393-86259d292186 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:05.206409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47047e63-020a-489f-8393-86259d292186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:05.206409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47047e63-020a-489f-8393-86259d292186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:05.206409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47047e63-020a-489f-8393-86259d292186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:05.206409 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47047e63-020a-489f-8393-86259d292186 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:05.206855 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1388/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:05.549564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=16 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:10.973362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:10.973926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:10.973926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:10.993180 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] MFA Rules not processed for user `b5c2fc3f3d5e4e7db1a13e24086e1f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:10.994429 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:11.052925 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1377/2765] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:11.361389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47047e63-020a-489f-8393-86259d292186 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:11.364998 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47047e63-020a-489f-8393-86259d292186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:11.384973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:11.418869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47047e63-020a-489f-8393-86259d292186 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:11.422513 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:11.423133 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:11.423430 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:11.423707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:11.426115 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:11.436009 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:11.437549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:11.446244 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1389/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:11.919154 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:11.920658 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:12.001645 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f5cb-b5b2-4235-bde3-4617e48fc084 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:12.028557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:12.028557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:12.028557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:12.028557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:12.029696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:12.029696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:12.029696 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:12.034444 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1378/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:21.595219 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=17 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:22.029780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=57 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:25.165070 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:25.166539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:25.186755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471705-f91c-4bbc-8952-297195bb4787 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:25.192521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:25.193123 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:25.193686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:25.193997 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:25.195709 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:25.211813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:25.213678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4297b6-1980-4b50-8aa8-22cfe928833c service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:25.226238 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1390/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:33.110467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:33.172355 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892b6a-f98a-4b14-814c-752d558695fb service placement] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:33.176935 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:33.177561 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:33.177862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:33.178220 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] PATH_INFO: `/v3/users/7e2d30768bc24ed7940b284848f9717b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:33.179398 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2d30768bc24ed7940b284848f9717b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:33.181332 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:33.334239 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2d30768bc24ed7940b284848f9717b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:33.342157 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2d30768bc24ed7940b284848f9717b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:33.388871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2d30768bc24ed7940b284848f9717b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:33.389504 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2d30768bc24ed7940b284848f9717b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:33.402233 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2d30768bc24ed7940b284848f9717b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:33.408995 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1379/2769] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:28:33 2022] DELETE /identity/v3/users/7e2d30768bc24ed7940b284848f9717b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:28:33.413689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:33.414209 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:33.414327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:33.435846 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:33.437230 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:33.498136 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1391/2770] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:33.507987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:33.509445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:33.568188 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2b19-7cc1-4195-8390-e7962a27857c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:33.571929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:33.572528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:33.572810 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:33.573088 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:33.582688 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:33.584122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:33.594203 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1380/2771] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:34.024879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:34.026406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:34.039239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99bdc-30c6-4709-bed9-03a8c4acc868 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:34.043891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:34.045182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:34.045517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:34.045788 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] PATH_INFO: `/v3/projects/3c32482781d74b5e9d3d7098262d0823` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:34.046975 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c32482781d74b5e9d3d7098262d0823)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:34.048894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:34.166105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c32482781d74b5e9d3d7098262d0823', 'request_id': 'req-aad65e87-1af2-4f3a-84ab-01c1a2e15805'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:34.172215 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c32482781d74b5e9d3d7098262d0823', 'request_id': 'req-aad65e87-1af2-4f3a-84ab-01c1a2e15805'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:34.178314 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c32482781d74b5e9d3d7098262d0823', 'request_id': 'req-aad65e87-1af2-4f3a-84ab-01c1a2e15805'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:34.256440 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] The token cache is being invalidate because project 3c32482781d74b5e9d3d7098262d0823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:28:34.256760 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:34.257381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:34.258901 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1392/2772] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:34 2022] DELETE /identity/v3/projects/3c32482781d74b5e9d3d7098262d0823 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:28:35.034984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:35.036353 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:35.049780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114601bd-a2d3-4d16-8f82-3539f65346ef service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:35.069379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:35.108169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:35.108831 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:35.109113 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:35.109391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] PATH_INFO: `/v3/users/7dbfda28a57647f1955e38acf410d18f` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:35.110651 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbfda28a57647f1955e38acf410d18f)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:35.112608 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:35.254063 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbfda28a57647f1955e38acf410d18f'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.261102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbfda28a57647f1955e38acf410d18f'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.314780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbfda28a57647f1955e38acf410d18f'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.315359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbfda28a57647f1955e38acf410d18f'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.327494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-428a3ce7-80ce-477a-bd75-6872604ed95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbfda28a57647f1955e38acf410d18f'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.333439 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1381/2773] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:28:35 2022] DELETE /identity/v3/users/7dbfda28a57647f1955e38acf410d18f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:28:35.591534 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:35.593329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:35.609418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65e87-1af2-4f3a-84ab-01c1a2e15805 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:35.673343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:35.673999 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:35.674278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:35.674550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] PATH_INFO: `/v3/projects/6692544b38264b1c94104e234259848b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:35.675665 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6692544b38264b1c94104e234259848b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:35.677561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:35.688456 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:35.789737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6692544b38264b1c94104e234259848b', 'request_id': 'req-ce640998-a0db-4deb-b58b-6ea45e2863e2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.795683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6692544b38264b1c94104e234259848b', 'request_id': 'req-ce640998-a0db-4deb-b58b-6ea45e2863e2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.801694 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6692544b38264b1c94104e234259848b', 'request_id': 'req-ce640998-a0db-4deb-b58b-6ea45e2863e2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.866169 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] The token cache is being invalidate because project 6692544b38264b1c94104e234259848b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:28:35.866466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.867110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:28:35.868625 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1393/2774] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:35 2022] DELETE /identity/v3/projects/6692544b38264b1c94104e234259848b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:28:45.329999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:45.859381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:00.160408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:00.161055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:00.161168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:00.181614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] MFA Rules not processed for user `b5c2fc3f3d5e4e7db1a13e24086e1f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:00.182784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:00.237637 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1382/2775] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:10.230881 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=25 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:07.231591 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:07.233172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:07.302898 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640998-a0db-4deb-b58b-6ea45e2863e2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:07.307903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:07.308508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:07.308792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:07.309220 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:07.310814 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:07.322623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:07.324262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6836b-e01f-4ad9-8b0b-5ceeebdf4b2c service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:07.334904 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1394/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:17.330084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=32 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:20.771858 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:20.773343 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:20.845760 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea896-0b17-4bda-82e2-6772a59ef69a None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:20.851874 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:20.852472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:20.852758 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:20.853035 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:20.854755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:20.865536 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:20.867163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:20.875929 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1383/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:30.871953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=34 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:36.454996 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:36.455463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:36.456891 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:36.475288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] MFA Rules not processed for user `b5c2fc3f3d5e4e7db1a13e24086e1f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:36.476477 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:36.483145 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1395/2778] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:46.469556 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:50.207223 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:50.218694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa807e77-299f-4a05-956c-1696ebf9b17d service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:50.224338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:50.226457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:50.226457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:50.226457 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:50.227328 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:50.241004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:50.242735 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:50.253382 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1384/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:00.248887 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=6 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:56.557706 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:56.559189 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:56.614986 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303d27-59fc-4fdf-ace5-60b590074d60 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:56.618785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:56.619382 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:56.619661 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:56.619935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:56.621745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:56.635467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:56.639056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:56.648292 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1396/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:59.709721 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.711161 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:59.723176 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc35b1-4a21-4dd3-8204-4fc57ce130ab service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.726753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.727334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.727614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.727888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.729699 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:59.743741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.745168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.756071 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1385/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:01.999470 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:02.000984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:02.056441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2ab90-fbc7-4bae-9736-72ccc2339b54 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:02.060035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:02.060636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:02.060916 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:02.061191 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:02.062946 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:02.072225 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:02.073648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:02.081493 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1397/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:05.303757 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:05.306075 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:05.321047 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0956-da0e-4139-b7fe-b7d1043b086b service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:05.327309 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e1030a5d0842f4b949a37a42ff753d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:05.327925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:05.328209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:05.328559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:05.330299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:05.343984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:05.345857 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:05.360824 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1386/2783] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:12.077897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=52 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:12.139471 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:12.148879 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0fb9f-6d18-473a-9f05-658b13c30bbd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:12.152526 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:12.153117 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:12.153420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:12.153698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:12.155433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:12.216592 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:12.218068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:12.228190 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1398/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:15.353624 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=12 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:15.675522 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:15.676969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:15.691731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612393b-c301-453d-84f2-5898ebae640e service nova] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:15.696621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:15.697255 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:15.697537 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:15.697814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:15.699540 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:15.711552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:15.713177 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:15.724045 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1387/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:15.795376 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:15.796953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:15.810165 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f51b41-5a20-411c-bfcb-e1a569793830 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:15.814738 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:15.816080 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:15.816368 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:15.816732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] PATH_INFO: `/v3/users/b5c2fc3f3d5e4e7db1a13e24086e1f8e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:15.817771 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c2fc3f3d5e4e7db1a13e24086e1f8e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:15.819725 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:15.992148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.062536 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.069613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.070293 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.082088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-92fdeb52-207b-4be5-a755-3a36ec89dc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c2fc3f3d5e4e7db1a13e24086e1f8e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.088005 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1399/2786] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:15 2022] DELETE /identity/v3/users/b5c2fc3f3d5e4e7db1a13e24086e1f8e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:16.350626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.363653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0da69-c403-492c-bec5-60468e4ea5e3 service placement] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.428965 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.429796 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.430207 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.430568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] PATH_INFO: `/v3/projects/48e13052e79e4d578da99b7c5f52d304` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.431750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e13052e79e4d578da99b7c5f52d304)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.433997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.565650 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e13052e79e4d578da99b7c5f52d304', 'request_id': 'req-9905e83e-b00b-48a2-9957-26b3cb0f5545'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.571218 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e13052e79e4d578da99b7c5f52d304', 'request_id': 'req-9905e83e-b00b-48a2-9957-26b3cb0f5545'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.578102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e13052e79e4d578da99b7c5f52d304', 'request_id': 'req-9905e83e-b00b-48a2-9957-26b3cb0f5545'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.634285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] The token cache is being invalidate because project 48e13052e79e4d578da99b7c5f52d304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:16.634571 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.635230 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-9905e83e-b00b-48a2-9957-26b3cb0f5545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.636730 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1388/2787] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:16 2022] DELETE /identity/v3/projects/48e13052e79e4d578da99b7c5f52d304 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:16.641794 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.642118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.642394 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.662767 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:16.663973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.722753 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1400/2788] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:16.730605 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.730891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.731231 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.751750 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:16.753572 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.761456 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1389/2789] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:16.765777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.776118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97592e-306a-446a-abb5-dd60143e80a4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.780871 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.781569 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.781876 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.782157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.782917 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:16.783226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.784892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.786819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:16.798119 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1401/2790] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:16.802317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.811531 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442faf7-36d4-4989-9536-db960f2f8446 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.816748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.817339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.817618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.817922 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.818568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.820462 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.928204 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1390/2791] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:16.932232 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.942487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3602a-d2cc-479e-a8a9-a4ae4eefed46 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.000531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.001131 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.001413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.001686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.002339 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.005074 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.091834 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1402/2792] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:17.095927 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.107315 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8676f4-cb94-440c-bf58-5ff665d2d3a5 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.111589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.112853 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.113150 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.113448 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.114317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.116014 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.127071 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1391/2793] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:17.131604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.142464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291049-2051-46fd-8502-7e682d3a9aa3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.147202 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.147798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.148076 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.148350 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.148987 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.150600 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69732a-c8fc-4649-a2c5-d767dc147786 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.161064 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1403/2794] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:17.165133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.175634 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202f5b0-90d3-4f78-bae1-fc90a2505e88 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.180421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.181004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.181306 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.181581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] PATH_INFO: `/v3/projects/4754012bdfa0497bb9432f03e89f0be0/users/e5329b4c8c7c407c9e9c20baef52799a/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.196452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4754012bdfa0497bb9432f03e89f0be0, user_id=e5329b4c8c7c407c9e9c20baef52799a, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.199163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.257627 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1392/2795] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:17 2022] PUT /identity/v3/projects/4754012bdfa0497bb9432f03e89f0be0/users/e5329b4c8c7c407c9e9c20baef52799a/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:17.269054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.269341 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.269619 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.296585 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] MFA Rules not processed for user `e5329b4c8c7c407c9e9c20baef52799a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:17.297816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:17.359829 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1404/2796] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:17.364824 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.378901 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:17.428483 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f9fd6-749d-4c50-99ec-5239b42b4c83 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.436062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.436062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.436062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.436062 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.436514 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.436936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.549550 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1393/2797] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:17.554390 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.565363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6a60-f262-4558-8f26-08aedcb63285 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.620681 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.621342 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.621621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.621928 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.622561 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.624492 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.633387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:17.685538 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1405/2798] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:17.690900 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.700327 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b74731-5e2a-4c48-ac91-95a5b2333d63 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.705052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.708228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.708228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.708228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.708228 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.708801 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.719385 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1394/2799] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:17.724095 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.734803 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467df58-2153-4168-aff9-ac76e0b2098a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.740181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.740827 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.741110 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.741393 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] PATH_INFO: `/v3/projects/361487995d564e54a9f4d3927d2aaf0a/users/0b48285736b749d6b6d5af059e7e6ea9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.756463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=361487995d564e54a9f4d3927d2aaf0a, user_id=0b48285736b749d6b6d5af059e7e6ea9, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.759250 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.811290 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1406/2800] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:17 2022] PUT /identity/v3/projects/361487995d564e54a9f4d3927d2aaf0a/users/0b48285736b749d6b6d5af059e7e6ea9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:17.815356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.826100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c04b1-7df4-4970-a798-cc1e0cc77833 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.886902 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.887505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.887790 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.888069 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.888713 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.890342 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07045b13-c252-4d11-a59a-9c4d2c4c6461 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.900692 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1395/2801] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:17.905047 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.916222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ec87-6f1c-4ec9-a0ae-ea55746b54dd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.920844 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.921483 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.921762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.922079 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] PATH_INFO: `/v3/projects/361487995d564e54a9f4d3927d2aaf0a/users/0b48285736b749d6b6d5af059e7e6ea9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.923971 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361487995d564e54a9f4d3927d2aaf0a, user_id=0b48285736b749d6b6d5af059e7e6ea9, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.926648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.936513 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1407/2802] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:17 2022] PUT /identity/v3/projects/361487995d564e54a9f4d3927d2aaf0a/users/0b48285736b749d6b6d5af059e7e6ea9/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:17.946641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.946913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.947194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.975512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] MFA Rules not processed for user `0b48285736b749d6b6d5af059e7e6ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:17.976732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:18.043528 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1396/2803] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:18.054711 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.059455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:18.112304 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f526-42f1-420f-a635-27a1ea346e12 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.116049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.116634 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.116911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.117183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.125913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.127344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.137162 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1408/2804] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:18.345782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.355494 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caf9f0-bf1a-4aea-a464-0820db771cf4 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.359022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.359616 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.359893 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.360162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.365219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:18.415565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.417005 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fc2d-14dc-47ac-8f79-e933ca6edfb7 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.426070 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1397/2805] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:28.133019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:28.438937 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=24 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:54.923495 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:54.985061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfa45a-2fab-47ce-9b6d-fc742dc23e7d service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:54.989604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:54.990267 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:54.990548 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:54.990825 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] PATH_INFO: `/v3/users/e5329b4c8c7c407c9e9c20baef52799a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:54.992036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5329b4c8c7c407c9e9c20baef52799a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:54.994747 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.155182 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5329b4c8c7c407c9e9c20baef52799a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.221714 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5329b4c8c7c407c9e9c20baef52799a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.229623 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5329b4c8c7c407c9e9c20baef52799a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.230308 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5329b4c8c7c407c9e9c20baef52799a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.242262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5329b4c8c7c407c9e9c20baef52799a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.248815 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1409/2806] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:54 2022] DELETE /identity/v3/users/e5329b4c8c7c407c9e9c20baef52799a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:55.253250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.253738 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.253862 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.272780 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:55.274037 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.332373 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1398/2807] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:55.342550 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.343964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.400241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbf7d6-aa43-4734-8a0e-f55fcae31b2a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.403936 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:55.404535 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.404818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.405094 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.414086 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:55.416214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.425562 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1410/2808] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:55.869237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.870834 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.884782 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa508b2-6391-48df-b696-4cf339d22da8 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.889618 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:55.890281 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.890564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.890859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] PATH_INFO: `/v3/projects/4754012bdfa0497bb9432f03e89f0be0` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.891984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4754012bdfa0497bb9432f03e89f0be0)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:55.893938 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.004406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4754012bdfa0497bb9432f03e89f0be0', 'request_id': 'req-df8bea70-e0dd-4133-bb2f-49ce38ed1436'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.010467 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4754012bdfa0497bb9432f03e89f0be0', 'request_id': 'req-df8bea70-e0dd-4133-bb2f-49ce38ed1436'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.016614 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4754012bdfa0497bb9432f03e89f0be0', 'request_id': 'req-df8bea70-e0dd-4133-bb2f-49ce38ed1436'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.090564 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] The token cache is being invalidate because project 4754012bdfa0497bb9432f03e89f0be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:56.090882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.091505 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.092997 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1399/2809] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:55 2022] DELETE /identity/v3/projects/4754012bdfa0497bb9432f03e89f0be0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:56.097044 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.106890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41950-3714-4902-a1ff-58a79dd2313a service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.124323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:56.163020 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.163644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.163920 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.164196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] PATH_INFO: `/v3/users/0b48285736b749d6b6d5af059e7e6ea9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.165349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b48285736b749d6b6d5af059e7e6ea9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.167354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.343932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b48285736b749d6b6d5af059e7e6ea9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.392572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b48285736b749d6b6d5af059e7e6ea9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.399796 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b48285736b749d6b6d5af059e7e6ea9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.400496 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b48285736b749d6b6d5af059e7e6ea9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.412798 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0485106d-26b9-40c5-aa8f-6a83e30fbbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b48285736b749d6b6d5af059e7e6ea9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.418863 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1411/2810] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:56 2022] DELETE /identity/v3/users/0b48285736b749d6b6d5af059e7e6ea9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:56.863477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.865028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:56.880168 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bea70-e0dd-4133-bb2f-49ce38ed1436 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.938945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.939579 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.939868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.940171 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] PATH_INFO: `/v3/projects/361487995d564e54a9f4d3927d2aaf0a` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.941295 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361487995d564e54a9f4d3927d2aaf0a)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.943279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.017710 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.034686 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361487995d564e54a9f4d3927d2aaf0a', 'request_id': 'req-345db29c-296d-4aae-9e73-967536bf0150'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.040630 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361487995d564e54a9f4d3927d2aaf0a', 'request_id': 'req-345db29c-296d-4aae-9e73-967536bf0150'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.046849 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361487995d564e54a9f4d3927d2aaf0a', 'request_id': 'req-345db29c-296d-4aae-9e73-967536bf0150'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.118362 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] The token cache is being invalidate because project 361487995d564e54a9f4d3927d2aaf0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:57.118929 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.120127 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-345db29c-296d-4aae-9e73-967536bf0150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.122141 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1400/2811] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:56 2022] DELETE /identity/v3/projects/361487995d564e54a9f4d3927d2aaf0a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:57.126764 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.127255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.127354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.146913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:57.148134 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.204994 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1412/2812] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:57.213458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.214028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.214308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.234033 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:57.235237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.243060 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1401/2813] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:57.247217 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.256713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add84342-0404-4b9c-bb3e-55bbaf2e0977 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.261403 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.262024 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.262303 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.262575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.263208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:57.263508 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.265088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.276772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1413/2814] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:57.281117 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.291112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00196e3-bf4d-4d87-8b62-16c8bfb44b47 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.295761 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.301871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.301871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.301871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.301871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.301871 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.371739 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1402/2815] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:57.375933 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.386181 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a59c5-bdd6-4a73-8894-36baa9b661b1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.412093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.442689 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.443279 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.443558 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.443845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.444441 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.446446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.524564 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1414/2816] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:57.534870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.545396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f3aaf-6578-4c14-be7b-503a653d9255 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.550156 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.550771 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.551052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.551326 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.551972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.553589 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.563568 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1403/2817] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:57.567401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.577755 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f610-722e-42ed-9a59-b7b6d31496e4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.582337 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.582953 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.583239 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.583520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.584154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.585741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc819-3400-408f-821d-60fe289098e7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.596897 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1415/2818] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:57.600863 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.610787 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb392-0ab0-4714-8ff6-680b1333049f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.615469 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.616098 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.616377 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.616652 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] PATH_INFO: `/v3/projects/4468c879deec4eb0a6ad3632f9e2b057/users/a9b782eb4da2494098cec76a3d8166f5/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.630674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4468c879deec4eb0a6ad3632f9e2b057, user_id=a9b782eb4da2494098cec76a3d8166f5, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.633303 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.713136 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1404/2819] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:57 2022] PUT /identity/v3/projects/4468c879deec4eb0a6ad3632f9e2b057/users/a9b782eb4da2494098cec76a3d8166f5/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:57.730148 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.730439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.730724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.757956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] MFA Rules not processed for user `a9b782eb4da2494098cec76a3d8166f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:57.759162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.822241 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1416/2820] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:57.827401 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.889043 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccfd1-8b00-4931-9ea1-afcedffba2b6 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.893626 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.894250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.894527 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.894800 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.895413 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.897317 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.976383 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1405/2821] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:57.980939 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.991816 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c6b43-c823-48e9-88b4-f038a379f5ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.047762 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.048362 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.048646 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.048921 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.049573 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.051576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.129984 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1417/2822] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:58.134460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.145056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c401b-61a5-43ab-b26d-31e88a403e03 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.149623 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.150238 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.150523 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.151236 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.151890 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.153501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.163913 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1406/2823] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:58.169560 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.179479 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091797fd-0a4d-4e1a-99e7-294f7cb5e96f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.184766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.185410 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.185713 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.186029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] PATH_INFO: `/v3/projects/2d7526a7707149b7987ca728b88a8c8d/users/8034a4418bfd42978db0f1a51f39788b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.200420 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7526a7707149b7987ca728b88a8c8d, user_id=8034a4418bfd42978db0f1a51f39788b, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.203097 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.273043 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1418/2824] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:58 2022] PUT /identity/v3/projects/2d7526a7707149b7987ca728b88a8c8d/users/8034a4418bfd42978db0f1a51f39788b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:58.277297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.287500 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d6d1-6055-4331-87c2-be1fce548411 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.309083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:58.345182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.345806 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.346119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.346391 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.347020 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.348602 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d262163-9359-4f73-b810-a862d96f0d4d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.358978 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1407/2825] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:58.363033 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.368511 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:58.397291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b298a-628d-46e0-bdbc-dd471332762d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.397291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.397291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.397291 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.397742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] PATH_INFO: `/v3/projects/2d7526a7707149b7987ca728b88a8c8d/users/8034a4418bfd42978db0f1a51f39788b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.397742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7526a7707149b7987ca728b88a8c8d, user_id=8034a4418bfd42978db0f1a51f39788b, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.397742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.397742 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1419/2826] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:58 2022] PUT /identity/v3/projects/2d7526a7707149b7987ca728b88a8c8d/users/8034a4418bfd42978db0f1a51f39788b/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:58.407994 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.408286 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.408570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.437427 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] MFA Rules not processed for user `8034a4418bfd42978db0f1a51f39788b`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:58.438797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:58.508275 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1408/2827] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:58.519735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.521439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:58.579895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b9597-46cf-4d57-9d79-908884968e59 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.583490 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.584096 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.584377 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.584653 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.593708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.595183 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799594e5-dfed-464a-a984-397474f0b710 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.604438 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1420/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:59.495373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.556324 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828aa23-b058-4df3-9618-fdc629db1b3c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.560928 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.561552 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.561848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.562130 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] PATH_INFO: `/v3/users/a9b782eb4da2494098cec76a3d8166f5` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.563240 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b782eb4da2494098cec76a3d8166f5)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.565146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.703975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b782eb4da2494098cec76a3d8166f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.705133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:59.711283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b782eb4da2494098cec76a3d8166f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.758763 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b782eb4da2494098cec76a3d8166f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.759308 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b782eb4da2494098cec76a3d8166f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.772368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b782eb4da2494098cec76a3d8166f5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.778965 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1409/2829] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:59 2022] DELETE /identity/v3/users/a9b782eb4da2494098cec76a3d8166f5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:59.783443 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.800491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.800491 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.803371 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:59.804663 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:59.861626 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1421/2830] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:59.871321 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.872795 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:59.931300 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb41e72-4aa1-4e8f-a732-1410755767e4 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.936163 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.936759 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.937040 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.937316 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.946143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.947576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.957482 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1410/2831] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:00.365387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:00.365387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:00.375354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34630adc-7c62-4a74-b6a0-3b63520323fd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:00.380001 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:00.380702 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.381002 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.381274 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] PATH_INFO: `/v3/projects/4468c879deec4eb0a6ad3632f9e2b057` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.382419 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4468c879deec4eb0a6ad3632f9e2b057)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:00.384384 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:00.496307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4468c879deec4eb0a6ad3632f9e2b057', 'request_id': 'req-3063ddbf-05ff-486a-b962-1088abd64491'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.501707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4468c879deec4eb0a6ad3632f9e2b057', 'request_id': 'req-3063ddbf-05ff-486a-b962-1088abd64491'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.507724 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4468c879deec4eb0a6ad3632f9e2b057', 'request_id': 'req-3063ddbf-05ff-486a-b962-1088abd64491'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.568913 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] The token cache is being invalidate because project 4468c879deec4eb0a6ad3632f9e2b057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:00.569205 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.569809 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.571408 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1422/2832] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:00 2022] DELETE /identity/v3/projects/4468c879deec4eb0a6ad3632f9e2b057 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:00.575484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:00.585287 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e9ba-8213-41a2-8942-6dc221151e55 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:00.640870 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:00.641434 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.641717 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.642025 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] PATH_INFO: `/v3/users/8034a4418bfd42978db0f1a51f39788b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.643135 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8034a4418bfd42978db0f1a51f39788b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:00.645050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:00.800835 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8034a4418bfd42978db0f1a51f39788b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.807797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8034a4418bfd42978db0f1a51f39788b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.856376 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8034a4418bfd42978db0f1a51f39788b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.857026 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8034a4418bfd42978db0f1a51f39788b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.862615 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:00.869880 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-34facf32-d453-409b-8248-093d528aa6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8034a4418bfd42978db0f1a51f39788b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.876103 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1411/2833] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:00 2022] DELETE /identity/v3/users/8034a4418bfd42978db0f1a51f39788b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:01.257455 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.261652 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:01.273678 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ddbf-05ff-486a-b962-1088abd64491 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.286522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:01.330618 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.331510 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.331811 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.332482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] PATH_INFO: `/v3/projects/2d7526a7707149b7987ca728b88a8c8d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.333622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7526a7707149b7987ca728b88a8c8d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.335612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.420892 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7526a7707149b7987ca728b88a8c8d', 'request_id': 'req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:01.426315 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7526a7707149b7987ca728b88a8c8d', 'request_id': 'req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:01.432218 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7526a7707149b7987ca728b88a8c8d', 'request_id': 'req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:01.495203 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] The token cache is being invalidate because project 2d7526a7707149b7987ca728b88a8c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:01.496004 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:01.496737 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-02a98dc8-6c49-4b99-acb4-aa41a627a0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:01.498356 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1423/2834] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:01 2022] DELETE /identity/v3/projects/2d7526a7707149b7987ca728b88a8c8d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:01.503472 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.503704 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.503983 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.524194 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:01.525528 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:01.583659 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1412/2835] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:01.591765 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.592049 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.592319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.611460 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:01.612645 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:01.620991 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1424/2836] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:01.625085 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.635118 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa08c02-9a4e-4b2d-a21c-1d3bd25d799c None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.640227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.640820 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.641105 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.641386 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.642067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:01.642384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.643989 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.655555 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1413/2837] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:01.659648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.668869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bbdd1-be50-4ef6-aacb-2929d3b0c63b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.673484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.674088 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.674367 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.674637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.675265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.677193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.754355 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1425/2838] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:01 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:01.758458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.769106 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79567bd-d46f-4fd5-8274-205f1a4fb1ea admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.824048 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.824719 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.824999 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.825227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.825879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.827794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.889866 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1414/2839] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:01 2022] POST /identity/v3/users => generated 278 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:01.894082 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.904784 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3c0-b527-4d7a-a0a5-e545a9a29b72 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.909617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.910241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.910519 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.910792 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.911427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.913062 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.923627 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1426/2840] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:01.928307 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.938972 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27322839-475d-4488-ad5a-c8bfea34facb admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.943669 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.944260 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.944541 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.944814 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.945451 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.947143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bbc2d-956c-40f9-a9b6-ae4341c809cd admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.957658 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1415/2841] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:01.961770 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:01.971899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d82e-0cd7-4f00-bb18-26c72ed2bb05 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.976482 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.977129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.977407 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.977683 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] PATH_INFO: `/v3/projects/570133e6c32a439686ee4a5365613469/users/f89e7e37dc7d4e1db47a975e6286d3b5/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.992907 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] RBAC: Authorizing `identity:create_grant(project_id=570133e6c32a439686ee4a5365613469, user_id=f89e7e37dc7d4e1db47a975e6286d3b5, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.996233 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.067823 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1427/2842] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:01 2022] PUT /identity/v3/projects/570133e6c32a439686ee4a5365613469/users/f89e7e37dc7d4e1db47a975e6286d3b5/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:02.077988 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.078282 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.078568 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.110123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] MFA Rules not processed for user `f89e7e37dc7d4e1db47a975e6286d3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:02.111378 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:02.153133 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:02.176293 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1416/2843] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:02.180707 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.225682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:02.242869 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c76-7539-4727-bcbe-7350ec98358f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.247729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.248322 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.248604 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.248941 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.249597 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.251590 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.360400 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1428/2844] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:02 2022] POST /identity/v3/projects => generated 355 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:02.364551 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.375252 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fe55f-966d-4340-a031-540fec5dff96 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.431090 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.431732 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.431990 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.432265 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.432899 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.434914 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.501575 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1417/2845] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:02 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:02.505638 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.516539 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73c678-c3bd-415b-8275-3d2af88cc421 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.521078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.521671 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.521989 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.522262 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.522903 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.524518 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.534608 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1429/2846] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:02.538653 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.548543 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4bc30-2a54-43c8-bb53-ae94ae79314f admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.553128 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.553762 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.554201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.554484 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] PATH_INFO: `/v3/projects/f7df1c58c382435fa22530a5fc0e6514/users/64f248ad9a7d4f0189f356f8cee1aa10/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.568755 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df1c58c382435fa22530a5fc0e6514, user_id=64f248ad9a7d4f0189f356f8cee1aa10, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.571458 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.632794 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1418/2847] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:02 2022] PUT /identity/v3/projects/f7df1c58c382435fa22530a5fc0e6514/users/64f248ad9a7d4f0189f356f8cee1aa10/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:02.637196 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.647222 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344377b-3382-426e-aa09-495afa1e8e5d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.701979 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.702575 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.702858 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.703138 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.703776 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.705363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461261d-d613-471a-9bc7-0d231af4fa29 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.715809 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1430/2848] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:02.719926 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.730219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8a2f-5f8d-4724-932c-30baefafffb2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.734736 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.735375 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.735655 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.735930 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] PATH_INFO: `/v3/projects/f7df1c58c382435fa22530a5fc0e6514/users/64f248ad9a7d4f0189f356f8cee1aa10/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.737825 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df1c58c382435fa22530a5fc0e6514, user_id=64f248ad9a7d4f0189f356f8cee1aa10, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.740481 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.750419 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1419/2849] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:02 2022] PUT /identity/v3/projects/f7df1c58c382435fa22530a5fc0e6514/users/64f248ad9a7d4f0189f356f8cee1aa10/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:02.814675 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.814962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.815238 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.843343 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] MFA Rules not processed for user `64f248ad9a7d4f0189f356f8cee1aa10`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:02.844547 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:02.911021 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1431/2850] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:02.922585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.924348 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:02.984204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417fbd-bf05-4514-82ea-1b99356ccd55 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.987794 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.988396 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.988679 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.988954 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.998419 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.999861 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:03.009109 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1420/2851] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:03.251955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:03.262029 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce7c9-8b19-4091-aa40-a9552aeb4c6e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:03.265503 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:03.266137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:03.266413 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:03.266682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:03.300520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:03.324525 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:03.326890 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e0a1-aaa1-47e3-a800-1d81029d3f80 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:03.335848 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1432/2852] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:13.004944 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:13.347327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=11 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:20.602873 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:20.671565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb420e-67dd-499c-9fad-ff8481f85a19 service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:20.676079 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:20.676724 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.677004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.677279 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] PATH_INFO: `/v3/users/f89e7e37dc7d4e1db47a975e6286d3b5` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.678405 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89e7e37dc7d4e1db47a975e6286d3b5)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:20.680339 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:20.825436 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89e7e37dc7d4e1db47a975e6286d3b5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.832442 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89e7e37dc7d4e1db47a975e6286d3b5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.894936 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89e7e37dc7d4e1db47a975e6286d3b5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.895554 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89e7e37dc7d4e1db47a975e6286d3b5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.908366 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89e7e37dc7d4e1db47a975e6286d3b5'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.914214 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1421/2853] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:20 2022] DELETE /identity/v3/users/f89e7e37dc7d4e1db47a975e6286d3b5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:20.918656 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.919119 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.919237 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.939509 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:20.940708 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:21.000613 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1433/2854] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:21.010359 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:21.011753 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:21.070007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d6ce-1bab-4f78-ba89-154eae49f816 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:21.073663 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:21.074369 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:21.074646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:21.074919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:21.084213 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:21.085588 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:21.096124 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1422/2855] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:21.479739 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:21.481168 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:21.493951 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce38623-64a4-49a5-880b-dde32a5fb6aa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:21.501344 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:21.501923 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:21.502206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:21.502480 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] PATH_INFO: `/v3/projects/570133e6c32a439686ee4a5365613469` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:21.503631 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570133e6c32a439686ee4a5365613469)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:21.505551 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:21.639741 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570133e6c32a439686ee4a5365613469', 'request_id': 'req-933bb23a-85d7-45f6-87f7-f11639158e49'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.645401 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570133e6c32a439686ee4a5365613469', 'request_id': 'req-933bb23a-85d7-45f6-87f7-f11639158e49'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.651740 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570133e6c32a439686ee4a5365613469', 'request_id': 'req-933bb23a-85d7-45f6-87f7-f11639158e49'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.739845 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] The token cache is being invalidate because project 570133e6c32a439686ee4a5365613469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:21.740137 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.740769 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.742294 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1434/2856] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:21 2022] DELETE /identity/v3/projects/570133e6c32a439686ee4a5365613469 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:21.746454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:21.756565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc5970-91d3-49b7-b3d3-a3da639217a6 service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:21.775285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:21.813742 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:21.814384 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:21.814666 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:21.814945 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] PATH_INFO: `/v3/users/64f248ad9a7d4f0189f356f8cee1aa10` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:21.816119 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f248ad9a7d4f0189f356f8cee1aa10)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:21.818159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:21.937432 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f248ad9a7d4f0189f356f8cee1aa10'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.944132 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f248ad9a7d4f0189f356f8cee1aa10'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.998844 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f248ad9a7d4f0189f356f8cee1aa10'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.999480 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f248ad9a7d4f0189f356f8cee1aa10'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.012123 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-b06dc936-2661-446f-8db6-2c58cb6104b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f248ad9a7d4f0189f356f8cee1aa10'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.018322 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1423/2857] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:21 2022] DELETE /identity/v3/users/64f248ad9a7d4f0189f356f8cee1aa10 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:22.382462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.383945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:22.398621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb23a-85d7-45f6-87f7-f11639158e49 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.457528 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.458056 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.458346 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.458628 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] PATH_INFO: `/v3/projects/f7df1c58c382435fa22530a5fc0e6514` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.459834 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7df1c58c382435fa22530a5fc0e6514)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.461752 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:22.542635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:22.558614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7df1c58c382435fa22530a5fc0e6514', 'request_id': 'req-c802f684-935f-4cbb-9e1c-b3543c1a5df5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.564016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7df1c58c382435fa22530a5fc0e6514', 'request_id': 'req-c802f684-935f-4cbb-9e1c-b3543c1a5df5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.569897 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7df1c58c382435fa22530a5fc0e6514', 'request_id': 'req-c802f684-935f-4cbb-9e1c-b3543c1a5df5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.636964 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] The token cache is being invalidate because project f7df1c58c382435fa22530a5fc0e6514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:22.637361 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.638017 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c802f684-935f-4cbb-9e1c-b3543c1a5df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.639636 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1435/2858] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:22 2022] DELETE /identity/v3/projects/f7df1c58c382435fa22530a5fc0e6514 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:22.644741 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.645030 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.645314 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.665299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:22.666590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:22.725461 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1424/2859] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:22.733065 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.733355 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.733635 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.753800 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:22.755061 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:22.762951 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1436/2860] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:22.767859 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.777518 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4ce4-539d-498a-a8e7-2d7003b80731 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.782297 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.782891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.783175 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.783454 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.784102 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:22.784412 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.786056 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:22.797981 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1425/2861] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:34:22.802059 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.812206 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe877a-eb88-4a42-9355-62e7b11436ad None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.816942 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.817544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.817823 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.818120 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.818757 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.820659 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:22.891281 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1437/2862] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:22 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:22.895383 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.905621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7422-bc5d-4b68-abb1-29258ae102ae admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.932365 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:22.967490 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.968217 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.968497 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.968804 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.969581 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.972146 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.134808 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1426/2863] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:22 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:23.138893 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.149193 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c5215-e120-4dd2-89bd-d7f42a7b1f9c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.154439 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.155124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.155432 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.155695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.156334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.157945 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.167833 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1438/2864] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:23.172406 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.182557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c768-63b9-4389-8fb1-a7144c70e416 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.187283 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.187866 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.188147 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.188421 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.189060 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.190786 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f7eaf-b9e6-498b-bec2-663ad3ae7ab8 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.202016 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1427/2865] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:23.205993 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.216129 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167c6a-a91e-4896-800a-13bcc8e4ad6f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.221289 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.221956 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.222241 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.222517 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] PATH_INFO: `/v3/projects/592578b5bd904c6cb129262e62e51bae/users/947300c1dc524934916a0694c1a67d7b/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.237568 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592578b5bd904c6cb129262e62e51bae, user_id=947300c1dc524934916a0694c1a67d7b, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.240195 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.323155 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1439/2866] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:23 2022] PUT /identity/v3/projects/592578b5bd904c6cb129262e62e51bae/users/947300c1dc524934916a0694c1a67d7b/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:23.334923 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.335209 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.335486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.364643 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] MFA Rules not processed for user `947300c1dc524934916a0694c1a67d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:23.367259 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:23.429416 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1428/2867] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:23.434140 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.495208 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a552-2b26-4fae-89de-756f4f0f6af8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.499813 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.500400 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.500682 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.500959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.501577 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.503520 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.593259 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1440/2868] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:23 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:23.597338 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.608302 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f8a9d-0170-40a7-99ef-3ff1a9b8f764 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.664199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.664792 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.665067 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.665340 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.666000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.667907 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.781033 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1429/2869] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:23 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:23.785099 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.795915 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425350d-398c-4a51-8ec8-57f05df3f8e4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.800546 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.801135 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.801446 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.801696 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.802381 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.803966 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.815946 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1441/2870] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:23.819991 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.830585 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8524-bcf7-462d-943e-778f5d4851ce admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.835216 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.835860 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.836139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.836416 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] PATH_INFO: `/v3/projects/6f8241a293c043e69aafd2acb807af29/users/35b505c227104620819fdee6e3a08c83/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.851162 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8241a293c043e69aafd2acb807af29, user_id=35b505c227104620819fdee6e3a08c83, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.853811 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.929008 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1430/2871] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:23 2022] PUT /identity/v3/projects/6f8241a293c043e69aafd2acb807af29/users/35b505c227104620819fdee6e3a08c83/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:23.932894 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.943686 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fd1f5-613c-490c-9c25-a049adf6fa4c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.964270 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:24.001259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.001895 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.002243 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.002531 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.003387 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.005265 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fabd8-8bc8-411a-8641-ec2917c14ef8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.015913 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1442/2872] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:24.020159 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.025638 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:24.031122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3df59a-f25e-42a3-8773-179eff1b791d admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.035718 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.036356 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.036640 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.036916 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] PATH_INFO: `/v3/projects/6f8241a293c043e69aafd2acb807af29/users/35b505c227104620819fdee6e3a08c83/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.038903 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8241a293c043e69aafd2acb807af29, user_id=35b505c227104620819fdee6e3a08c83, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.049151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.051645 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1431/2873] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:24 2022] PUT /identity/v3/projects/6f8241a293c043e69aafd2acb807af29/users/35b505c227104620819fdee6e3a08c83/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:24.062106 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.062399 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.062679 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.090630 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] MFA Rules not processed for user `35b505c227104620819fdee6e3a08c83`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:24.091959 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:24.158495 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1443/2874] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:24.169712 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.171576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:24.228121 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec476f-973f-4191-b27d-3144a174a142 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.231748 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.232879 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.233155 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.233418 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.242199 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.243641 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.253779 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1432/2875] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:24.446475 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.456261 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d19d0-d743-494b-a89a-5fd24df40fa6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.460162 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.460462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.460746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.461025 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.516932 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.518418 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d2bc-947c-4d47-a02e-ac3ba2726c12 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.527158 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1444/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:32.960399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:33.022100 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcda6-1875-4386-aeb7-587e24cced1d service cinder] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:33.026788 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:33.027407 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:33.027693 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:33.027969 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] PATH_INFO: `/v3/users/947300c1dc524934916a0694c1a67d7b` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:33.029084 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=947300c1dc524934916a0694c1a67d7b)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:33.031076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:33.199187 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947300c1dc524934916a0694c1a67d7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.206320 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947300c1dc524934916a0694c1a67d7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.277708 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947300c1dc524934916a0694c1a67d7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.278346 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947300c1dc524934916a0694c1a67d7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.291066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947300c1dc524934916a0694c1a67d7b'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.296862 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1433/2877] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:32 2022] DELETE /identity/v3/users/947300c1dc524934916a0694c1a67d7b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:33.301487 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:33.306775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:33.306775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:33.320622 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:33.321819 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:33.361349 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:33.380581 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1445/2878] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:33.390576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:33.391979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:33.406382 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:33.450077 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874c03-e6e3-4ffa-b3a0-b7b0a1c1de5a admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:33.453617 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:33.454247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:33.454570 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:33.454830 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:33.464791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:33.467450 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:33.476057 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1434/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:33.822777 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:33.824369 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:33.837648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ae1b-9047-4915-aa3e-cdec22fa86c2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:33.842780 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:33.843415 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:33.843698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:33.843982 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] PATH_INFO: `/v3/projects/592578b5bd904c6cb129262e62e51bae` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:33.845089 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592578b5bd904c6cb129262e62e51bae)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:33.847363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:33.964154 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592578b5bd904c6cb129262e62e51bae', 'request_id': 'req-83cb9805-f1dc-4093-bca5-6a357dffae88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.969644 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592578b5bd904c6cb129262e62e51bae', 'request_id': 'req-83cb9805-f1dc-4093-bca5-6a357dffae88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.976132 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592578b5bd904c6cb129262e62e51bae', 'request_id': 'req-83cb9805-f1dc-4093-bca5-6a357dffae88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.037544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] The token cache is being invalidate because project 592578b5bd904c6cb129262e62e51bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:34.037855 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.038484 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.040032 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1446/2880] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:33 2022] DELETE /identity/v3/projects/592578b5bd904c6cb129262e62e51bae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:34.044028 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.054513 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c7e8f-0430-497c-993b-5350b04943eb service neutron] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:34.109122 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:34.109734 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.110052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.110331 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] PATH_INFO: `/v3/users/35b505c227104620819fdee6e3a08c83` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.112076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b505c227104620819fdee6e3a08c83)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:34.114023 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:34.279674 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b505c227104620819fdee6e3a08c83'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.287001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b505c227104620819fdee6e3a08c83'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.351501 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b505c227104620819fdee6e3a08c83'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.352139 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b505c227104620819fdee6e3a08c83'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.366388 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-2683ca61-afd8-4288-a0d7-511248674754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b505c227104620819fdee6e3a08c83'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.372299 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1435/2881] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:34 2022] DELETE /identity/v3/users/35b505c227104620819fdee6e3a08c83 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:34.817354 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.818821 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.832878 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9805-f1dc-4093-bca5-6a357dffae88 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:34.889320 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:34.889967 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.890248 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.890522 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] PATH_INFO: `/v3/projects/6f8241a293c043e69aafd2acb807af29` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.891615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8241a293c043e69aafd2acb807af29)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:34.894091 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:34.998245 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8241a293c043e69aafd2acb807af29', 'request_id': 'req-286185f1-62de-4f3e-9bdc-94c91f6a04a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:35.004316 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8241a293c043e69aafd2acb807af29', 'request_id': 'req-286185f1-62de-4f3e-9bdc-94c91f6a04a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:35.010463 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8241a293c043e69aafd2acb807af29', 'request_id': 'req-286185f1-62de-4f3e-9bdc-94c91f6a04a8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:35.090307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.095019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] The token cache is being invalidate because project 6f8241a293c043e69aafd2acb807af29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:35.095307 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:35.096035 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-286185f1-62de-4f3e-9bdc-94c91f6a04a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:35.097542 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1447/2882] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:34 2022] DELETE /identity/v3/projects/6f8241a293c043e69aafd2acb807af29 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:35.102411 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.102856 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.103022 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.122426 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:35.123657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:35.153444 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.182812 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1436/2883] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:35.192772 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.193060 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.193334 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.213278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:35.214802 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:35.222869 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1448/2884] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:35.227299 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.236979 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d3b2-50af-46a7-82d4-6bf140aa65bc None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.241595 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.242227 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.242512 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.242791 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.243460 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:35.243770 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.245358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.257347 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1437/2885] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:35.261684 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.271603 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb361-1854-4bbc-8813-8248578017d7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.276157 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.282374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.282374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.282374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.282374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.282374 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.388113 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1449/2886] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.392116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.402371 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b148-b4d6-485d-9231-96c4821a9f5c admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.457381 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.458004 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.458285 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.458557 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.459169 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.461078 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.528774 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1438/2887] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.532965 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.543804 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5b18-5f11-4bc1-a46a-e8d5462f43b4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.548462 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.549578 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.551158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.551158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.551158 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.552406 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.562251 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1450/2888] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.566997 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.577082 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aefe7-a0e2-478f-8810-a070388372c1 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.582087 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.582672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.582953 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.583232 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.583868 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.585452 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bfb5e-7e66-4a9a-80f5-1f10bc91a931 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.597247 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1439/2889] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.601226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.611732 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca98114-bc77-46b1-ac04-588ed9f5575f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.616467 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.617105 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.617389 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.617664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] PATH_INFO: `/v3/projects/7c95794e364e4d4bb1780566a2873d59/users/782bb1a48d414343ab7628d79e67e1e5/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.633698 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c95794e364e4d4bb1780566a2873d59, user_id=782bb1a48d414343ab7628d79e67e1e5, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.636363 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.696275 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1451/2890] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:35 2022] PUT /identity/v3/projects/7c95794e364e4d4bb1780566a2873d59/users/782bb1a48d414343ab7628d79e67e1e5/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:35.706620 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.706910 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.707190 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.734636 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] MFA Rules not processed for user `782bb1a48d414343ab7628d79e67e1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:35.735839 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:35.798196 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1440/2891] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:35.803176 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.862745 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665d5a-921f-478c-b011-5584432d92a7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.867507 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.868112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.868380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.868657 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.869278 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.871226 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.953293 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1452/2892] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.957538 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.968590 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbea9-2cfa-40f0-80ba-3d0879278092 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.996050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:36.024456 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.025083 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.025373 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.025931 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] PATH_INFO: `/v3/users` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.026622 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.028984 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.100747 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1441/2893] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:36.104854 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.115427 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6743f-000d-4e72-a42f-d5d85d66673c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.120036 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.120625 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.120906 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.121174 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.121812 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.123424 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.133665 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1453/2894] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:36.138000 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.148970 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518a60-3d96-42d3-8fbc-ba29638b9321 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.153657 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.154336 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.154619 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.154895 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] PATH_INFO: `/v3/projects/553068fc35dd48f99736568a69dd1bbd/users/11d0a26808ed4c2ab8e643999148f87c/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.169973 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553068fc35dd48f99736568a69dd1bbd, user_id=11d0a26808ed4c2ab8e643999148f87c, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.172621 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.221341 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1442/2895] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:36 2022] PUT /identity/v3/projects/553068fc35dd48f99736568a69dd1bbd/users/11d0a26808ed4c2ab8e643999148f87c/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:36.225276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.235324 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5fe4d-0964-4a78-8274-b55648013bd3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.290485 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.291084 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.292092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.292092 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.292323 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.293926 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221272ec-7e78-4c96-8873-bf550d01b947 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.303798 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1454/2896] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:36.307987 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.318403 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc897c-1777-4b52-b460-625da4a74db2 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.323052 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.323694 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.323974 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.324256 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] PATH_INFO: `/v3/projects/553068fc35dd48f99736568a69dd1bbd/users/11d0a26808ed4c2ab8e643999148f87c/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.326204 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553068fc35dd48f99736568a69dd1bbd, user_id=11d0a26808ed4c2ab8e643999148f87c, role_id=d21ddf2cafe84e9f807fa5c7d1fd44f7)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.328919 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.339769 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1443/2897] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:36 2022] PUT /identity/v3/projects/553068fc35dd48f99736568a69dd1bbd/users/11d0a26808ed4c2ab8e643999148f87c/roles/d21ddf2cafe84e9f807fa5c7d1fd44f7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:36.350911 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.351201 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.351478 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.359411 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:36.378617 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] MFA Rules not processed for user `11d0a26808ed4c2ab8e643999148f87c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:36.379818 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.447869 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1455/2898] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:36.459477 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.461165 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.518672 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093fccd-4ecd-4614-aded-1884a68c4612 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.522277 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.522869 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.523151 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.523425 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.532166 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.533731 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf0086-5748-42bf-82c2-df2ad0406a72 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.543134 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1444/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:39.202992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.264187 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec1f4-797d-4229-8a0b-3585d0b41219 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.268624 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.269329 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.269544 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.269815 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] PATH_INFO: `/v3/users/782bb1a48d414343ab7628d79e67e1e5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.270955 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782bb1a48d414343ab7628d79e67e1e5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.272857 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.484984 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782bb1a48d414343ab7628d79e67e1e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.574613 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782bb1a48d414343ab7628d79e67e1e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.582614 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782bb1a48d414343ab7628d79e67e1e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.583319 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782bb1a48d414343ab7628d79e67e1e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.595729 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782bb1a48d414343ab7628d79e67e1e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.601747 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1456/2900] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:39 2022] DELETE /identity/v3/users/782bb1a48d414343ab7628d79e67e1e5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:39.606269 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.606784 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.606891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.625182 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:39.626438 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:39.684204 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1445/2901] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:39.694391 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.695790 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:39.707251 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:39.752348 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f44f-df1a-48cf-a5bb-7dce28abf840 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.755962 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.756559 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.756842 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.757118 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.766019 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.768122 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.778557 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1457/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:40.187865 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.190141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:40.202237 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf56f9-a647-4116-a394-25885c238fac None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.206882 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.207547 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.207798 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.208076 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] PATH_INFO: `/v3/projects/7c95794e364e4d4bb1780566a2873d59` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.209379 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c95794e364e4d4bb1780566a2873d59)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.211334 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.233264 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:40.313247 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c95794e364e4d4bb1780566a2873d59', 'request_id': 'req-a955357e-1922-4200-a8aa-36fc47f374ce'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.318905 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c95794e364e4d4bb1780566a2873d59', 'request_id': 'req-a955357e-1922-4200-a8aa-36fc47f374ce'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.325280 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c95794e364e4d4bb1780566a2873d59', 'request_id': 'req-a955357e-1922-4200-a8aa-36fc47f374ce'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.414958 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] The token cache is being invalidate because project 7c95794e364e4d4bb1780566a2873d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:40.415250 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.416007 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.417507 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1446/2903] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:40 2022] DELETE /identity/v3/projects/7c95794e364e4d4bb1780566a2873d59 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:40.421588 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.432068 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df72cf-e597-446c-b010-5996daab1753 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.488748 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.489380 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.489664 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.489963 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] PATH_INFO: `/v3/users/11d0a26808ed4c2ab8e643999148f87c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.491149 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d0a26808ed4c2ab8e643999148f87c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.493054 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.616124 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d0a26808ed4c2ab8e643999148f87c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.666093 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d0a26808ed4c2ab8e643999148f87c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.673257 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d0a26808ed4c2ab8e643999148f87c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.674087 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d0a26808ed4c2ab8e643999148f87c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.686164 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-58c99ab7-adbf-475e-a213-53b7f078ee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d0a26808ed4c2ab8e643999148f87c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.692095 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1458/2904] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:40 2022] DELETE /identity/v3/users/11d0a26808ed4c2ab8e643999148f87c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:41.051219 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.054074 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.067888 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955357e-1922-4200-a8aa-36fc47f374ce admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.131006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.131006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.131006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.131006 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] PATH_INFO: `/v3/projects/553068fc35dd48f99736568a69dd1bbd` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.131493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=553068fc35dd48f99736568a69dd1bbd)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.131493 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.226445 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553068fc35dd48f99736568a69dd1bbd', 'request_id': 'req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.231913 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553068fc35dd48f99736568a69dd1bbd', 'request_id': 'req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.238066 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553068fc35dd48f99736568a69dd1bbd', 'request_id': 'req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.310998 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] The token cache is being invalidate because project 553068fc35dd48f99736568a69dd1bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:41.311275 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.311891 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-5955ac6c-d1b0-418b-be2a-28fd176a3e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.313372 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1447/2905] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:41 2022] DELETE /identity/v3/projects/553068fc35dd48f99736568a69dd1bbd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:41.318961 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.319256 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.319746 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.339615 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:41.340851 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.366388 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:41.400485 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1459/2906] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:41.409711 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.410050 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.410368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.431515 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:41.432766 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.441391 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1448/2907] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:41.445549 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.456007 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c305f3-1945-496a-be9c-ecc7cd0aa70f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.460636 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.461212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.461493 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.461766 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.462436 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:41.462742 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.464601 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.477182 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1460/2908] 10.222.0.36 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:41.481479 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.491845 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982ce27-5485-4bcf-93a9-de977b0d433f None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.496576 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.503201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.503201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.503201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.503201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.503201 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.593005 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1449/2909] 10.222.0.36 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:41.598288 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.608433 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d611f4-16b4-4e96-9b5f-63e20acde8ce admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.663935 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.664466 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.664744 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.665016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.665648 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.667673 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.762222 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1461/2910] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:41.766361 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.777486 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5cb27-1d7c-4b60-b6fa-6197fb24a377 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.782112 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.782706 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.782975 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.783251 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.783925 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.785511 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.787578 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:41.796036 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1450/2911] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:41.800098 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.810521 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634a01-d34f-4926-99c9-ff9f145bcc42 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.815276 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.815867 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.816147 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.816943 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.817695 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.819497 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49bcdd-6db8-4df1-90cc-c3cb7fb28d86 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.830109 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1462/2912] 10.222.0.36 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:41.834940 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.845070 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607fa9-6247-411f-9490-91d859dbe244 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.849920 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.850559 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.850841 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.851116 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] PATH_INFO: `/v3/projects/50d10932cde04cbe8ea823a754e7f0f0/users/e736a14ba793472a8c6e69fa156fd016/roles/f097b8e696684df78b8f3a53be01a5d9` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.865661 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d10932cde04cbe8ea823a754e7f0f0, user_id=e736a14ba793472a8c6e69fa156fd016, role_id=f097b8e696684df78b8f3a53be01a5d9)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.868350 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.946740 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1451/2913] 10.222.0.36 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:41 2022] PUT /identity/v3/projects/50d10932cde04cbe8ea823a754e7f0f0/users/e736a14ba793472a8c6e69fa156fd016/roles/f097b8e696684df78b8f3a53be01a5d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:41.958572 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.958860 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.959141 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.986973 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] MFA Rules not processed for user `e736a14ba793472a8c6e69fa156fd016`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:41.988172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.051641 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1463/2914] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:42.062797 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:42.064443 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.120646 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a937-7dac-4f7f-87f3-a29ac6f20e35 admin admin] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:42.124258 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e19c7f04deb4b04b4c2d98ca7323b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.124848 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] REQUEST_METHOD: `GET` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.125125 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.125399 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.134141 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.135573 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50eb71-068c-40e8-b5d8-9cb1bcf1f553 service cinder] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.144164 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1452/2915] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:45.177321 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:45.206983 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:45.239621 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b492d-d42e-4d81-83a7-b02aa4b23afb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:45.244184 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:45.244820 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.245112 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.246992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] PATH_INFO: `/v3/users/e736a14ba793472a8c6e69fa156fd016` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.246992 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e736a14ba793472a8c6e69fa156fd016)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:45.248464 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.428637 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e736a14ba793472a8c6e69fa156fd016'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.517580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e736a14ba793472a8c6e69fa156fd016'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.524576 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e736a14ba793472a8c6e69fa156fd016'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.525214 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e736a14ba793472a8c6e69fa156fd016'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.537259 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e736a14ba793472a8c6e69fa156fd016'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.543067 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1464/2916] 10.222.0.36 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:45 2022] DELETE /identity/v3/users/e736a14ba793472a8c6e69fa156fd016 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:45.547530 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] REQUEST_METHOD: `POST` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.548016 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.548143 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.567968 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.auth.core [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] MFA Rules not processed for user `a7ab3d54af314822bc2df0049ba7e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:45.569164 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:45.626003 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1453/2917] 10.222.0.36 () {58 vars in 958 bytes} [Sun Aug 7 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:45.635775 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:45.637212 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:45.693125 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1007471-6347-44de-873e-aec1ca4fe477 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:45.696735 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ee4ba08ab84302b567df30df796e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:45.697327 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.697605 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.697899 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.706580 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:45.708078 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.717554 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1465/2918] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:46.131221 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] Authenticating user token {{(pid=80509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.132648 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.fernet_utils [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:46.147349 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafba61-8754-4a52-b58e-397dbe590b29 None None] Validating token access rules against request {{(pid=80509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.152179 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ab3d54af314822bc2df0049ba7e2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d8f722b65514efcbdc7ef3dc7a594c9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.152815 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.153099 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.153408 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] PATH_INFO: `/v3/projects/50d10932cde04cbe8ea823a754e7f0f0` {{(pid=80509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.154565 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d10932cde04cbe8ea823a754e7f0f0)` {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.156532 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] RBAC: Authorization granted {{(pid=80509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.273368 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d10932cde04cbe8ea823a754e7f0f0', 'request_id': 'req-38424bcb-07d2-4df6-b585-b63b2d1b1826'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.278875 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d10932cde04cbe8ea823a754e7f0f0', 'request_id': 'req-38424bcb-07d2-4df6-b585-b63b2d1b1826'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.285008 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d10932cde04cbe8ea823a754e7f0f0', 'request_id': 'req-38424bcb-07d2-4df6-b585-b63b2d1b1826'} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.365134 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG dbcounter [-] [80509] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:46.369055 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] The token cache is being invalidate because project 50d10932cde04cbe8ea823a754e7f0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:46.369358 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.370001 dv-cinder-master-3-smb devstack@keystone.service[80509]: DEBUG keystone.notifications [None req-38424bcb-07d2-4df6-b585-b63b2d1b1826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.372985 dv-cinder-master-3-smb devstack@keystone.service[80509]: [pid: 80509|app: 0|req: 1454/2919] 10.222.0.36 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:46 2022] DELETE /identity/v3/projects/50d10932cde04cbe8ea823a754e7f0f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:55.713177 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:11.235736 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:11.237255 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:11.371856 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a249167-2b5b-42b9-90d0-62dc9e382f5f service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:11.427785 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23e2e7e9bb442b9a76fb6c47b35d99a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f874cd3a8c7840c4996026cbbc27ebc3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:11.428378 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:11.428655 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:11.428929 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:11.431172 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:11.442016 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:11.443586 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f01f-ada8-4dd8-87cb-4600abd20785 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:11.453772 dv-cinder-master-3-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1466/2920] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:21.449612 dv-cinder-master-3-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}